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For example, we cover the simpler finite-state machines, not Turing 
machines. We have limited the coverage of abstract algebra to a discussion of 
semigroups and groups and have given applications of these to the important 
topics of finite-state machines and error-detecting and error-correcting codes. 
Error-correcting codes, in turn, have been primarily restricted to simple linear 
codes. 

Second, the material has been organized and interrelated to minimize the 
mass of definitions and the abstraction of some of the theory. Relations and 
digraphs are treated as two aspects of the same fundamental mathematical idea, 
with a directed graph being a pictorial representation of a relation. This funda- 
mental idea is then used as the basis of virtually all the concepts introduced in 
the book, including functions, partial orders, graphs, and algebraic structures. 
Whenever possible, each new idea introduced in the text uses previously encoun- 
tered material and, in turn, is developed in such a way that it simplifies the more 
complex ideas that follow. Thus partial orders, lattices, and Boolean algebras 
develop from general relations. This material in turn leads naturally to other alge- 
braic structures. 


What Is New in the Third Edition 


We have been very pleased by the warm reception given to the first two editions 
of this book. We have repeatedly been told that the book works well in the class- 
room because of the unifying role played by two key concepts: relations and 
digraphs. Thus we have not drastically interfered with the organization or flow of 
the material. We have added some more flexibility and modularity while contin- 
uing the centrality of relations and digraphs. In preparing this edition, we have 
incorporated many faculty and student suggestions. Although many changes have 
been made in this edition, our goal continues to be that of maximizing the clar- 
ity of presentation. To achieve this goal, the following features have been devel- 
oped in this edition: 


New Sections Have Been Added on 


¢ Mathematical Structures (showing similarities and differences in the struc- 
ture of sets and set operations, integers and integer arithmetic, and matrices 
and matrix operations). 

The predicate calculus. 

Recurrence relations. 

Functions for computer science. 

Growth of functions. 

¢ Minimal spanning trees. 
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A new chapter has been added on Graph Theory. 

Appendix B, Experiments in Discrete Mathematics, has been added. 
Coding exercises have been included in each chapter. 

More material on recursion lias been included. 

More material on logic and methods of proof has been presented. 
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Exercises 
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+ The presentation on permutations and combinations has been expanded. 

« More figures and illustrative examples have been prepared. 

« The Exercise Sets have been revised. Many of the routine exercises have been 
kept, others of this type have been created, and more emphasis has been 
placed on exercises asking the student to explain and describe. 


The exercises form an integral part of the book. Many are computational in 
nature, whereas others are of a theoretical type. Many of the latter and the exper- 
iments, to be further described below, require verbal solutions. Answers to all 
odd-numbered exercises appear in the back of the book. Solutions to all exer- 
cises appear in the Instructor’s Manual, which is available (to instructors only) 
gratis from the publisher. The Instructor’s Manual also includes notes on the ped- 
agogical ideas underlying each chapter, goals and grading guidelines for the 
experiments further described below, and a test bank. 


Appendix B contains a number of assignments that we call experiments. These 
provide an opportunity for discovery and exploration, or a more-in-depth look at 
various topics discussed in the text. These are suitable for group work. Content 
prerequisites for each experiment are given in the Instructor’s Manual. 


End of Chapter Material 


Content 


Every chapter contains a summary of Key Ideas for Review and a set of Coding 
Exercises, 


Chapter 1 contains a miscellany of basic material required in the course. This 
includes sets, subsets, and their operations; sequences; division in the integers; 
and matrices. New to this edition is a section on Mathematical Structures, show- 
ing the similarities and differences among some of the concepts discussed earlier 
in the chapter. Chapter 2 covers logic and related material, including methods of 
proof and mathematical induction. It includes two sections that are new to this 
edition: Conditional Statements and Methods of Proof. Chapter 3, on counting, 
deals with permutations, combinations, the pigeonhole principle, elements of 
probability, and a new section on Recurrence Relations. 

Chapter 4 presents basic types and properties of relations, along with their 
representation as directed graphs. Connections with matrices and other data 
structures are also explored in this chapter. Chapter 5 deals with the notion of a 
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function and gives several important examples of functions, including permuta- 
tions. New to this edition are sections on Functions for Computer Science and 
Growth of Functions. Chapter 6, new to this edition, provides an elementary 
introduction to some of the ideas and applications of graph theory. It gives addi- 
tional flexibility and modularity to the text. 

Chapter 7 covers partially ordered sets, including lattices and Boolean alge- 
bras. Chapter 8 introduces directed and undirected trees. New to this edition is a 
section on Minimal Spanning Trees. In Chapter 9 we give the basic theory of semi- 
groups and groups. These ideas are applied in Chapters 10 and 11. Chapter 10 is 
devoted to finite-state machines. It complements and makes effective use of ideas 
developed in previous chapters. Chapter 11 treats the subject of binary coding. 

Appendix A discusses Algorithms and Pseudocode. The simplified 
pseudocode presented here is used in some text examples and exercises; these 
may be omitted without loss of continuity. Appendix B gives a collection of 
experiments dealing with extensions or previews of topics in various parts of the 
course. 


Use of This Text 


This text can be used by students in mathematics as an introduction to the fun- 
damental ideas of discrete mathematics, and as a foundation for the development 
of more advanced mathematica. concepts. If used in this way, the topics dealing 
with specific computer science applications can be ignored or selected indepen- 
dently as important examples. The text can also be used in a computer science or 
computer engineering curriculura to present the foundations of many basic com- 
puter-related concepts, and provide a coherent development and common theme 
for these ideas. The instructor can easily develop a suitable course by referring to 
the chapter prerequisites, which icentify material needed by that chapter. 
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CHAPT E, 


Prerequisites 


There are no formal prerequisites for this chapter; the reader is encouraged to 
read carefully and work through all examples. 


In this chapter we introduce some of the basic tools of discrete mathematics. We 
begin with sets, subsets, and their operations, notions with which you may already 
be familiar. Next we deal with sequences, using both explicit and recursive pat- 
terns. Then we review some of the basic divisibility properties of the integers. 
Finally, we introduce matrices and their operations. This gives us the background 
needed to begin our exploration of mathematical structures. 


1.1. Sets and Subsets 
Sets 


A set is any well-defined collection of objects, called the elements or members of 
the set. For example, the collection of all wooden chairs, the collection of all one- 


1 


2 


Chapter 1 


Fundamentals 


legged black birds, or the collection of real numbers between zero and one is each 
a set. Well defined just means it is possible to decide if a given object belongs to 
the collection or not. Almost all mathematical objects are first of all sets, regard- 
less of any additional properties that they may possess. Thus, set theory is, in a 
sense, the foundation on which virtually all of mathematics is constructed. In spite 
of this, set theory (at least the informal brand we need) is easy to learn and use. 

One way of describing a set that has a finite number of elements is by list- 
ing the elements of the set between braces. Thus the set of all positive integers 
that are less than 4 can be written as 


{1, 2, 3}. ql) 


The order in which the elements of a set are listed is not important. Thus 
{1, 3, 2}, {3, 2, 1}, {3, 1, 2}, {2, 1, 3}, and {2, 3, 1} are all representations of the set 
given in (1). Moreover, repeated elements in the /isting of the elements of a set 
can be ignored. Thus {1, 3, 2,3, 1} is another representation of the set given in (1). 

We use uppercase letters such as A, B, C to denote sets and lowercase let- 
ters such as a, b,c, x, y, Z, t to denote the members (or elements) of sets. 

We indicate the fact that x is an element of the set A by writing x € A. We 
also indicate the fact that x is not an element of A by writing x € A. 


Example 1. Let A = {1,3,5,7}.Then 1 € A,3 € A, but 2 € A. Ad 


Sometimes it is inconvenient or impossible to describe a set by listing all its 
elements. Another useful way tc: define a set is by specifying a property that the 
elements of the set have in common. We use the notation P(x) to denote a sen- 
tence or statement P concerning the variable object x. The set defined by P(x), 
written {x | P(x)} is just the collection of all objects x for which P is sensible and 
true. For example, {x | x is a positive integer less than 4} is the set {1, 2,3} described 
in (1) by listing its elements. 


Example 2. The set consisting of all the letters in the word “byte” can be de- 
noted by {b, y, t, e} or by {x ! x is a letter in the word “byte”}. Sd 


Example 3. We introduce hee several sets and their notations that will be used 
throughout this book. 


(a) Z* = {x| xis a positive integer}. 
Thus Z* consists of the nurnbers used for counting: 1,2,3,.... 
(b) N = {x |x is a positive integer or zero}. 
Thus N consists of the positive integers and zero: 0,1,2,.... 
(c) Z = {x| x is an integer}. 
Thus Z consists of all the irttegers:..., —3, —2, -1,0,1,2,3,.... 
(d) R = {x| x is a real number}. 
(e) The set that has no elements in it is denoted either by { } or the sym- 
bol @ and is called the enspty set. 


Example 4. Since the square of a real number is always nonnegative, {x | x is a 
real number and x? = —1} = Z. + 
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Sets are completely known when their members are all known. Thus we say 
two sets A and B are equal if they have the same elements, and we write A = B. 


Example 5. If.A = {1,2,3} and B = {x| xis a positive integer and x* < 12}, then 


A=B. 4 
Example 6. If A = {BASIC, PASCAL, ADA} and B = {ADA, BASIC, PAS- 
CAL}, then A = B. ° 
Subsets 


If every element of A is also an element of B, that is, if whenever x € A then 
x € B, we say that A is a subset of B or that A is contained in B, and we write 
A C B.If A is not a subset of B, we write A ¢ B. (See Figure 1.1.) 


oO) 


ACB AGB 
Figure 1.1 


Diagrams, such as those in Figure 1.1, which are used to show relationships 
between sets, are called Venn diagrams after the British logician John Venn. Venn 
diagrams will be used extensively in Section 1.2. 


Example 7. We have Z* C Z. Moreover, if Q denotes the set of all rational num- 
bers, then ZC Q. 


Example 8. Let A = {1, 2, 3,4, 5, 6}, B = {2, 4, 5}, and C = (1, 2, 3, 4, 5}. Then 
BCA,BCC,and CC A. However,A € B,A ¢ C,andC ZB. 4 


Example 9. If A is any set, then A C A. That is, every set is a subset of itself. 


Example 10. Let A be a set and let B = {A, {A}}. Then, since A and {A} are ele- 
ments of B, we have A € B and {A} € B. It follows that {A} C B and {{A}} C = 
However, it is not true that A C B. 


For any set A, since there are no elements of © that are not in A, we have 
@ CA. (We will look at this again in Section 2.1.) 

It is easy to see that A = B if and only if A C Band B C A. (This is proved 
in Section 2.3.) 

The collection of everything, it turns out, cannot be considered a set with- 
out destroying the logical structure of mathematics. To avoid this and other prob- 
lems, which need not concern us here, we will assume that for each discussion 
there is a universal set U (which will vary with the discussion) containing all 
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objects for which the discussior is meaningful. Any other set mentioned in the 
discussion will automatically be assumed to be a subset of U. Thus, if we are dis- 
cussing real numbers and we mention sets A and B, then A and B must (we 
assume) be sets of real numbers, not matrices, electronic circuits, or rhesus mon- 
keys. In most problems, a universal set will be apparent from the setting of the 
problem. In Venn diagrams, the universal set U will be denoted by a rectangle, 
while sets within U will be denoted by circles, as shown in Figure 1.2. 


U 


Figure 1.2 


Aset A is called finite if it has 1 distinct elements, where n € N. In this case, 
nis called the cardinality of A and is denoted by |A |. Thus, the sets of Examples 
1, 2,4, 5, and 6 are finite. A set that is not finite is called infinite. The sets intro- 
duced in Examples 3 (except @) and 7 are infinite sets. 

If A is a set, then the set of all subsets of A is called the power set of A and 
is denoted by P(A). 


Example 11. Let A = {1,2,3}. Then P(A) consists of the following subsets of A: 


{}, {1}, {2}, {3}, (1, 2}, {1, 3}, {2, 3}, and {1, 2, 3} (or A). In a later section, we will 
count the number of subsets that a set can have. ¢ 


EXERCISE SET 1.1 


1. Let A = {1, 2, 4, a, b,c}. Identify each of the fol- 4. In each part, give the set by listing its elements. 
lowing as true or false. (a) The set of all positive integers that are less 
(a)2EA (b) 3EA (c) cEA than ten 
(d) @EA (e) {JA (f) AEA (b) {x |x € Zand x? < 12} 


5, In each part, write the set in the form {x | P(x)}, 
where P(x) is a property that describes the ele- 
ments of the set. 


2. Let A = {x|x is areal number and x < 6}. 
Identify each of the following as true or false. 


eee Socee apse (a) (2,4,6,8, 10} (b) fa,e,i,0,u) 
" Se (©) {1,8,27,64,125} (a) {-2,-1,0,1,2) 
3. In each part, give the set of letters in each word 6. Let A = {1,2, 3, 4,5}. Which of the following 
by listing the elements of the set. sets are equal to A? 
(a) AARDVARK (b) BOOK (a) {4,1,2,3,5} (b) {2.3.4} (c) (1,2,3,4,5,6] 


(c) MISSISSIPPI (d) {x |x is an integer and x? = 25} 


(e) {x |x is a positive integer and x = 5} 
(f) {x |x is a positive rational number and 


7. Which of the following sets are the empty set? 
(a) {x |x is a real number and x” —1 = 0} 


(b) {x |x is a real number and x? + 1 = 0} 
{x [x is a real number and x? = —9} 

(d) {x |x is a real number and x = 2x + 1} 

(e) {x |x is a real number and x = x + 1} 


8. List all the subsets of {a, 5}. 


9. List all the subsets of {BASIC, PASCAL, 
ADA}. 


10. List all the subsets of { }. 


11. Let A = {1,2,5, 8, 11}. Identify each of the fol- 
lowing as true or false. 


(a) [5,1} CA (b) {8,1} € A 
(c) {1,82,11,5}2A (d) OCA 
(e) {1,6} ZA (f) QQ) CA 
(g) B}EA (h) A C {11,2,5,1,8, 4} 


12. Let A = {x |x is an integer and x? < 16}. 
Identify each of the following as true or false. 
(a) {0,1,2,3}C A (b) (-3,-2, -1] CA 
() (JCA 
(d) {x |x is an integer and|x| <4} CA 
(e) AC {-3, -2, -1,0,1,2, 3} 


13. Let A = {1}, B = {1, 4,2, b,c}, C = {b,c}, 
D = {a, b}, and E = {1, a, 2, b, c, d}. For each 
part, replace the symbol L with either C or ¢ 
to give a true statement. 
(a) ADB (b) GOA (c) BOC 
(d) COE (ec) DOC () BOE 


14. In each part, find the set of smallest cardinality 
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that contains the given sets as subsets. 
(a) {a, b,c}, (a, d,e, f), (b,c, e, 8) 
(b) {1,2}, {1,3}, — (c) {La}, {b, 2} 


15. Use the Venn diagram in Figure 1.3 to identify 
each of the following as true or false. 


(a) ACB (b) BCA (c) CCB 
(d)xEB (e) xEA (ff) yEB 
U 
2 
Figure 1.3 


16. (a) If A = {3,7}, find P(A). 
(b) What is|.A|?  (c) What is | P(A)|? 


17. (a) If A = (3,7, 2}, find P(A). 
(b) What is|A|? (c) What is | P(A)|? 


18. Draw a Venn diagram that represents these 
relationships. 
(a) ACB,ACC,BEC,andCZB 
(b) xE A, XEBXxECyEByeCandyEA 


19. Describe all the subset relationships that hold 
for the sets given in Example 3. 


20. Prove that if A C Band BC C,thenA CC. 


In this section we will discuss several operations that will combine given sets to 
yield new sets. These operations, which are analogous to the familiar operations 
on the real numbers, will play a key role in the many applications and ideas that 


follow. 
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If A and B are sets, we define their union as the set consisting of all ele- 
ments that belong to A or B and denote it by A U B. Thus 


AU B= {x|x A orx € B}. 
Observe that x © A U Bifx € A or x € B or x belongs to both A and B. 
Example 1. Let A = {a, b,c, e,f} and B = {b,d,r,s}. Find A U B. 


Solution: Since A U B consists of all the elements that belong to either A 
or B,A U B = {a, b,c, d,e, f,r,s}. Sa 


We can illustrate the union of two sets with a Venn diagram as follows. If A 
and B are the sets given in Figure 1.4(a), then A U Bis the set represented by the 
shaded region in Figure 1.4(b). 


A B 


(a) (b) AUB 
Figure 1.4 


If A and B are sets, we define their intersection as the set consisting of all 
elements that belong to both A and B and denote it by A N B. Thus AN B = 
{x|x € A and x © B}. 


Example 2. Let A = {a, b, c, e, f}, B = {b, e, f, r,s}, and C = {a, t, u, v}. Find 
ANB,ANC,and BNC. 


Solution: The elements b, , and f are the only ones that belong to both A 
and B,so A M B = {b, e, f}. Similarly, A M C = {a}. There are no elements 
that belong to both B and C,so BN C = {}. Sd 


Two sets that have no common elements, such as B and C in Example 2, are 
called disjoint sets. 

We can illustrate the intersection of two sets by a Venn diagram as follows. 
If A and B are the sets given in Figure 1.5(a), then A M B is the set represented 
by the shaded region in Figure 1.5(b). Figure 1.6 illustrates a Venn diagram for 
two disjoint sets. 

The operations of union and intersection can be defined for three or more 
sets in an obvious manner. 


AUBUC= {x]xE€Aorx€ Borx EC} 
and 


ANBNC = {x|x€A andx € Bandx EC}. 
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U 
(a) (b) ANB 
Figure 1.5 
U 
Figure 1.6 


The shaded region in Figure 1.7(b) is the union of the sets A, B, and C shown in 
Figure 1.7(a), and the shaded region in Figure 1.7(c) is the intersection of the sets 
A, B, and C. Note that Figure 1.7(a) says nothing about possible relationships 
between the sets, but allows for all possible relationships. In general, if 
Aj, A;,...,A, are subsets of U, then Ay U A, U-+:+U A, will be denoted by 


Ube 4, and Ay A, N---M A, will be denoted by (jn1 Ax 


Example 3. Let A = (1, 2,3, 4,5, 7), B = {1, 3, 8, 9}, and C = (1, 3, 6, 8}. Then 
AM BN Cis the set of elements that belong to A, B, and C.ThuuaANBNC= 
(1, 3}. e 


If A and B are two sets, we define the complement of B with respect to A 
as the set of all elements that belong to A but not to B, and we denote it by 
A — B.Thus 


A- B= (x|x€Aandx € BI. 


Example 4. Let A = {a, b, c} and B = {b, c, d, e}. Then A ~ B = {a} and 
B-A= ({d,eé}. ° 


If A and B are the sets in Figure 1.8(a), then A — B and B ~— A are repre- 
sented by the shaded regions in Figures 1.8(b) and 1.8(c), respectively. 

If Uis a universal set containing A, then U — A is called the complement of 
A and is denoted by A. Thus A = {x |x € A}. 


Example 5. Let A = {x |x is an integer and x < 4} and U = Z. Then A = 
{x | x is an integer and x > 4}. ° 
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(a) (b) AUBUC 


(ec) ANBNC 
Figure 1.7 


(a) (b) 


Figure 1.8 
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If A is the set in Figure 1.9, its complement is the shaded region in that 
figure. 


Figure 1.9 


If A and B are two sets, we define their symmetric difference as the set of 
all elements that belong to A or to B, but not to both A and B, and we denote it 
by A © B. Thus 


AQ@B = {x| (x € A and x € B) or (x € Band x € A)}. 


Example 6. Let A = {a, b,c, d} and B = {a,c, e, f, g|. Then A ® B = {b, d,e, 
8}. ° 


If A and B are as indicated in Figure 1.10(a), their symmetric difference is 
the shaded region shown in Figure 1.10(b). It is easy to see that 


A@B=(A-B)U(B—A). 


(a) - (b)AGB 
Figure 1.10 


Algebraic Properties of Set Operations 


The operations on sets that we have just defined satisfy many algebraic proper- 
ties, some of which resemble the algebraic properties satisfied by the real num- 
bers and their operations. All the principal properties listed here can be proved 
using the definitions given and the rules of logic. We shall prove some of the 
properties and leave the remaining proofs as exercises for the reader. Venn dia- 
grams are often useful to suggest or justify the method of proof. 
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Theorem 1. The operations defined on sets satisfy the following properties. 


Commutative Properties 
1.AUB=BUA 
2,.ANB=BNA 


Associative Properties 

3. AU(BUC)=(AUB)UC 

4. AN(BNC)=(ANB)NC 
Distributive Properties 

5. AN(BUC)=(ANB)U(ANC) 
6 AU(BNC)=(AUVA)N(AUC) 


Idempotent Properties 
7. AUA=A 
8 ANA=A 

Properties of the Complement 
9, (A)=A 

10. AUA=U 

1. ANA=D 

12. =U 

3.U={} 

14. AUB=ANB 

15, ANB=AUB Froperties 14 and 15 are known as De Morgan’s 


laws. 


Properties of a Universal Set 
16. AUU=U 
17. ANU=A 


Properties of the Empty Set 
18. AUM=A or AU{}=A 
19 AND=O or AN{}={} 


Proof: We will prove Property 14 here and leave proofs of the remaining 
properties as exercises for the reader. A common style of proof for state- 
ments about sets is to chocse an element in one of the sets and see what we 
know about it. Suppose that x € A U B. Then we know that x € A U B,so 
x € A and x € B. (Why?) This means x € AB (why?), so each element 
of A U B belongs to AN B.ThusA UBCANB. Conversely, suppose that 
x€ANB.Thenx €Aandx¢B 3 (why?),so x ¢ A U B, which means that 
x € A U B.Thus each element of AN B ~ ee tod U B,and ANB 


C AU B.Nowwe see that.4 U B= AN A 


The Addition Principle 


Suppose now that A and B are finite sets of a universal set U. It is frequently use- 


ful to have a formula for 


joint sets, that is, if A M B = ©, then each element of A U B appears in either A 
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or B, but not in both; therefore, |A U B|=|A/ + |B|. If A and B overlap, as shown 
in Figure 1.11, then elements in A M B belong to both sets, and the sum 
|A| + [B| counts these elements twice. To correct for this double counting, we 
subtract |A M B|. Thus we have the following theorem, sometimes called the 
addition principle. Because of Figure 1.11, this is also called the inclusion- 
exclusion principle. 


Figure 1.11 
Theorem 2. Jf A and B are finite sets, then AU B| =|A|+|B|-|ANB|. @ 


Example 7. Let A = {a,b,c,d,e} and B = {c,e,f,h, k, m}. Verify Theorem 2. 
Solution: We have A U B = {a,b,c,d,e,f,h,k,m} and AM B = {c,e}. Also, 
|A|=5, B) =6,|A U B|=9,and|A N B| = 2.Then|A|+ |B] —|ANM Bl = 
5 + 6 — 2 or 9 and Theorem 2 is verified. e 


If A and B are disjoint sets, A  B = @ and AM B| = 0,so the formula in 
Theorem 2 now becomes |A U B| = |.A| + |B]. This special case can be stated in 
a way that is useful in a variety of counting situations. 


The Addition Principle for Disjoint Sets 


If a task T, can be performed in exactly n ways, and a task T, can be performed 
in exactly m ways, then the number of ways of performing task T, or task 7, is 
n+m 

The situation for three sets is a bit more complicated, as we show in Figure 
1.12. We state the three-set addition principle without discussion. 


ANB 


Figure 1.12 
Theorem 3. Let A,B, and C be finite sets. Then AU BUC|= A|+|B|+|C|- 
|ANB| -|BNC|-|ANC|+|ANBNC. o 


Example 8. Let A = {a,b,c,d,e}, B = {a, b,e, g,h}, and C = {b, d, e, g,h, k, m, n}. 
Verify Theorem 3. 
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Solution: We have A U BU C = {a, b,c, d,e, g,h, k, m,n}, AN B= 
{a, b,e}, AN C = {b, d.e}, BO C = {b, e, g, h}, and AN BNC = {b, e}, so 
|A| =5,|B]=5,|C|=§,|AUBUC|=10,/AN B| =3,/|ANC =3, 
|BQ Cl =4,and|AN BN C| =2.Thus|A|+|B)+|C -|ANB| - 
IBNC|-|ANC|+|ANBNC| =54+54+8-3-3-4+2or10, and 
Theorem 3 is verified. . 2 


Example 9. A computer company must hire 25 programmers to handle systems 
programming jobs and 40 programmers for applications programming. Of those 
hired, ten will be expected to perform jobs of both types. How many program- 
mers must be hired? 


Solution: Let A be the set of systems programmers hired and B be the set 
of applications programmers hired. The company must have |.A| = 25 and 
|B =40,and|A O B| = 10. The number of programmers that must be hired 
is|A U B|,but|A UB =|A| +|B| —|A/N B|.So the company must hire 
25 + 40 — 10 or 55 prograinmers. SO 


Example 10. A survey has been taken on methods of commuter travel. Each 
respondent was asked to check BUS, TRAIN, or AUTOMOBILE as a major 
method of traveling to work. More than one answer was permitted. The results 
reported were as follows: BUS, 30 people; TRAIN, 35 people; AUTOMOBILE, 
100 people; BUS and TRAIN, 15 people; BUS and AUTOMOBILE, 15 people; 
TRAIN and AUTOMOBILE, 20 people; and all three methods, 5 people. How 
many people completed a survev form? 


Solution: Let B, T,and A be the sets of people who checked BUS, TRAIN, 
and AUTOMOBILE, respectively. We know | B| = 30,|7| = 35,|A_ = 100, 


[BN T|=15,|BNA|=15,|TM A| = 20,and|BN T N.A| =5.So0/|B| + 
|T| +|A|-|BNT|-|BNA|—-|TNA|+|BNTNA| = 304354 
100 — 15 — 15 — 20 + 5 or 120 is|A U BU C|, the number of people who 
responded. od 
EXERCISE SET 1.2 
In Exercises 1 through 4, let U = {a, b,c, d, e, f, 3. Compute 
8h, k}, A = {a, b,c, g}, B = {d,e,f, 8}, C = (ay AUBUC  (b) ANBNC 
{a,c,f},and D = {f,h, k}. (ce) AN(BUC) dd) AUB)NC 
(e) AUB (f) ANB 
1. Compute 
(a) AUB (b) BUC (c) ANC 4. Compute 
(d) BND (e) A~B (f) A @ AUD (b) AUU (c) BUB 
ASR hy Age @)Cn{} (CUD (f) CAD 
2. Compute 
(a) AUD (b) BUD (c) CND In Exercises 5 and 6, let U = {1, 2,3, 4,5, 6,7, 8, 9}, 
(d) AND (e) B-C (f) B A = {1,2, 4, 6,8}, B = {2,4,5,9}, C = {x| xis 
(g) C-B (h) C@D a positive integer and x? <= 16}, and D = {7,8}. 


5. Compute 
(a) AUB (b) AUC (c) AUD 
(d) BUC (fe) ANC () AND 
(g) BNC (h) CND (i) A-B 
G) B-A (k) C-D (l) € 
(m) A (n) A®B (0) C@D 
(p) BOC 

6. Compute 


fa) AUBUC (bd) ANBNC 
(c) AN(BUC) (d) (AUB)ND 


(e) AUB (f) ANB 
(2) BUCUD (hy BNCND 
(i) AUA (JANA 

(k) AUA () AN(CUD) 


In Exercises 7 and 8, let U = {a, b, c, d,e, f, g, h}, 


A = {a,c,f, g), B = {a, e}, B = {a, e}, and 
C = {b, h}. 


7. Compute 
(a) A (b) B (c) AUB 
(d) ANB (e) U (f) A-B 
8. Compute 
(a) ANB (b) BUC (c) AUA 
(a) CNS (ec) A®B () BOC 


9, Let Ube the set of real numbers, A = {x |x isa 


solution of x7 — 1 = 0}, and B = {~1, 4}. Compute 
(a) A (b) B (c) AUB 


(d) ANB 


In Exercises 10 and 11, refer to Figure 1.13. 


Figure 1.13 


10. Identify the following as true or false. 
(a) yEANB (b) xE BUC 
(co) wE BNC (d)wEéc 
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11. Identify the following as true or false. 


(a)xEANBNC  (b) yEAUBUC 
(c) zEANC (d) VEBNC 


12. Describe the shaded region shown in Figure 


1.14 using unions and intersections of the sets 
A, B, and C. (Several descriptions are possible.) 


Figure 1.14 


13. Let A, B, and C be finite sets with |A| = 6, 


|B|=8,|C|=6,|AUBUC| =11,|/ANB|= 
3,|A 0 Cl = 2, and|B NM C| = 5. Find 
[AN BNC. 


14. Verify Theorem 2 for the following sets. 


(a) A= {1,2,3,4}, B = (2,3, 5, 6,8} 
(b) A = {1,2, 3,4}, B = (5,6, 7, 8, 9} 
(c) A = {a,b,c,d,e,f}, B= lao fg,h,ir| 
(d) A = {a, b,c, d,e}, B = {f,.g.r,5,6,u} 
(e) A = {x|x is a positive integer < 8}, 
B = {x |x is an integer such that 2 <x <5} 
(f) A = {x |x is a positive integer and x? = 16}, 
B = {x |x is a negative integer and x” = 25} 


15. If A and B are disjoint sets such that |A U B| = 


|A 


, what must be true about B? 


16. Verify Theorem 3 for the following sets: 


(a) A = {a,b, c,d, e}, B = {d,e, f,g,h, i, kh, 
C = {a,c,d,e,k, r,s, t} 
(b) A = (1,2, 3, 4,5, 6}, B = (2,4, 7,8, 9}, 
C= {1,2,4,7, 10, 12} 
(c) A = {x|x isa positive integer < 8}, 
B = {x | xis an integer such that 2 <x = 4}, 
C = {x! xis an integer such that x” < 16} 


17. Ina survey of 260 college students, the follow- 


ing data were obtained: 
64 had taken a mathematics course, 
94 had taken a computer science course, 
58 had taken a business course, 
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28 had taken both a mathematics and a busi- 
ness course, 

26 had taken both a mathematics and a com- 
puter science course, 

22 had taken both a computer science and a 
business course, and 

14 had taken all three types of courses. 

(a) How many students were surveyed who 
had taken none of the three types of 
courses? 

(b) Of the students surveyed, how many had 
taken only a computer science course? 


18. A survey of 500 television watchers produced 
the following information: 285 watch football 
games, 195 watch hockey games, 115 watch bas- 
ketball games, 45 watch football and basketball 
games, 70 watch football and hockey games, 50 
watch hockey and basketball games, and 50 do 
not watch any of the three kinds of games. 

(a) How many people in the survey watch all 
three kinds of games? 

(b) How many people watch exactly one of the 
sports? 


19. 


In a psychology experiment, the subjects under 
study were classified according to body type 
and gender as follows: 


Endomorph Ectomorph Mesomorph 


Male 72 54 36 
Female 62 64 38 


(a) How many male subjects were there? 
(b) How many subjects were ectomorphs? 
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(c) How many subjects were either female or 
endomorphs? 

(d) How many subjects were not male meso- 
morphs? 

(e) How many subjects were either male, ecto- 
morph, or mesomorph? 


20. Prove thatA CAUB. 
21. Prove that AN BCA. 


22, (a) Draw a Venn diagram to represent the situ- 
ation C C AandC CB. 
(b) Prove that if C C A and C C B, then 
CCAUB. 


23. (a) Draw a Venn diagram to represent the situ- 
ation AC CandBCC. 
(b) Prove that if A ¢ Cand B C C, then 
AUBCC. 


24. Prove that A —- A=. 

25. Prove that A- B= ANB. 

26. Prove that A — (A — B) CB. 

27. If A U B= AUC, must B = C? Explain. 
28. If AM B= AN C, must B= C? Explain. 


29. Prove that if AC Band CC D,then A UCC 
BUDandANCCBND. 


30. When is A — B = B — A? Explain. 


Some of the most important sets arise in connection with sequences. A sequence 
is simply a list of objects in order: a first element, second element, third element, 
and so on. The list may stop after n steps, n € N, or it may go on forever. In the 
first case we say that the sequence is finite, and in the second case we say that it 
is infinite. The elements may all be different, or some may be repeated. 


Example 1. The sequence 1, 0, 0, 1, 0,1, 0,0, 1, 1, 1 is a finite sequence with 
repeated items, The digit zero, for example, occurs as the second, third, fifth, sev- 
enth, and eighth elements of the sequence. a 
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Example 2. The list 3, 8, 13, 18, 23, ...is an infinite sequence. The three dots in 
the expression mean “and so on”; that is, continue the pattern established by the 
first few elements. Sd 


Example 3. Another infinite sequence is 1, 4, 9, 16, 25,..., the list of the squares 
of all positive integers. Sd 


It may happen that how a sequence is to continue is not clear from the first 
few terms. Also, it may be useful to have a compact notation to describe a 
sequence. Two kinds of formulas are commonly used to describe sequences. In 
Example 2, a natural description of the sequence is that successive terms are pro- 
duced by adding 5 to the previous term. If we use a subscript to indicate a term’s 
position in the sequence, we can describe the sequence in Example 2 as a, = 3, 
a,=4,.,+5,2=n<.A formula like this, which refers to previous terms to 
define the next term, is called recursive. Every recursive formula must include a 
starting place. 

On the other hand, in Example 3 it is easy to describe a term using only its 
position number. In the nth position is the square of n; b, = 1’, 1 <n < ©. This 
type of formula is called explicit, because it tells us exactly what value any par- 
ticular term has. 


Example 4. The recursive formula c, = 5,c, = 2c,_;,2 =n = 6, defines the 
finite sequence 5, 10, 20, 40, 80, 160. 4 


Example 5. The infinite sequence 3, 7, 11, 15, 19, 23,...can be defined by the 
recursive formula d, = 3, d, = d,_, + 4. ° 


Example 6. The explicit formula s, = (—4)", 1 = n < ~, describes the infinite 
sequence —4, 16, —64, 256,.... Aa 


Example 7. The finite sequence 87, 82,77, 72, 67 can be defined by the explicit 
formula t, = 92 -5n,1Sn=5. ° 
Example 8. An ordinary English word such as “sturdy” can be viewed as the 
finite sequence 


s,t,u,r,d,y 


composed of letters from the ordinary English alphabet. Sd 


In examples such as Example 8, it is common to omit the commas and write 
the word in the usual way, if no confusion results. Similarly, even a meaningless 
word such as “abacabcd” may be regarded as a finite sequence of length 8. 
Sequences of letters or other symbols, written without the commas, are also 
referred to as strings. 


Example 9. An infinite string such as abababab. .. may be regarded as the infi- 
nite sequence a, b, a, b, a, b,.... 4 


Example 10. The sentence “now is the time for the test” can be regarded as a 
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finite sequence of English words: now, is, the, time, for, the, test. Here the ele- 
ments of the sequence are themselves words of varying length, so we would not 
be able simply to omit the commas. The custom is to use spaces instead of com- 
mas in this case. ° 


The set corresponding to a sequence is simply the set of all distinct elements 
in the sequence. Note that an essential feature of a sequence is the order in which 
the elements are listed. However, the order in which the elements of a set are 
listed is of no significance at all. 


Example 11 
(a) The set corresponding to the sequence in Example 3 is {1, 4, 9, 16, 25,...}. 
(b) The set corresponding to the sequence in Example 9 is simply {a, b}. °° 


The idea of a sequence is iraportant in computer science, where a sequence 
is sometimes called a linear array or list. We will make a slight but useful distinc- 
tion between a sequence and aii array and use a slightly different notation. If we 
have a sequence S: s,, 5, 83,..., we think of all the elements of S as completely 
determined. The element s,, for example, is some fixed element of S, located in 
position four. Moreover, if we change any of the elements s, we have a new 
sequence and will probably name it something other than S. Thus, if we begin 
with the finite sequence S: 0, 1, 2,3, 2,1, 1 and we change the 3 to a 4, getting 
0,1,2,4,2, 1,1, we would think of this as a different sequence, say S% 

An array, on the other hand, may be viewed as a sequence of positions, 
which we represent in Figure 1.15 as boxes. The positions form a finite or infinite 
list, depending on the desired size of the array. Elements from some set may be 
assigned to the positions of the array S. The element assigned to position x will 
be denoted by S[n], and the sequence S{1], S[2], S[3], ... will be called the 
sequence of values of the array S$. The point is that S is considered to be a well- 
defined object, even if some of the positions have not been assigned values or if 
some values are changed during the discussion. The following shows one use of 
arrays. 


si] S[2} S[3] 
Aly SS: Je Se ee ee 
1 2 3 


Figure 1.15 


Characteristic Functions 


A very useful concept for sets is the characteristic function. We discuss functions 
in Section 5.1, but for now we can proceed intuitively and think of a function on 
a set as a rule that assigns some “value” to each element of the set. If A is a sub- 
set of a universal set U, the characteristic function f, of A is defined as follows: 
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1 ifxEA 
fale) = {} ifxZ A. 


We may add and multiply characteristic functions, since their values are 
numbers, and these operations sometimes help us prove theorems about proper- 
ties of subsets. 


Theorem 1. Characteristic functions of subsets satisfy the following properties: 
(a) fans = Sfafys that is, fix glx) = fale) fg(X) for all x. 
(b) favs = fat fa — fafps that is, fy vale) = fae) + fa) — fa fa@) for 
all x. 
(c) fags =fat fy — 2fafys that is, fx eX) = 4) + fe) — 2faCOfe() 


for all x. 


Proof: (a) f4(x) fp(x) equals 1 if and only if both f,(x) and f,(x) are equal 
to 1, and this happens if and only if x is in A and x is in B, that is, x is in 
ANB. Since f,f, is 1 on A M B and 0 otherwise, it must be f, , ,. 

(b) Ifx € A, then f,(x) = 1,80 f4(x) + fo%) — fa@)fa(®) = 1 + fo) - 
f,(x) = 1. Similarly, when x € B, f(x) + fa(x) — fa(x) fp(x) = 1. If x is not 
in A or B, then f,(x) and f,(x) are 0, so f,(x) + fg(x) — f4®) f(x) = 0. Thus 
fa + fx ~ fa fgis 1 on A U B and 0 otherwise, so it must be f,,, g- 

(c) We leave the proof of (c) as an exercise. od 


Computer Representation of Sets and Subsets 


Another use of characteristic functions is in representing sets in a computer. To 
represent a set in a computer, the elements of the set must be arranged in a 
sequence, The particular sequence selected is of no importance. When we list the 
set A = {a, b,c,...,r}, we normally assume no particular ordering of the elements 
in A. Let us identify for now the set A with the sequence a, b, c,...,7. 

When a universal set U is finite, say U = {x,, x,,...,x,} and A is a subset of 
U, then the characteristic function f, assigns 1 to an element x, that belongs to A 
and 0 to an element x; that does not belong to A. Thus f, can be represented by 
a sequence of 0’s and 1’s of length x. 


Example 12. Let U = {1,2,3,4,5, 6}, A = {1,2}, B = {2,4, 6}, and C = {4,5, 6}. 
Then f,(x) has value 1 when x is 1 or 2 and otherwise is 0. Hence f, corresponds 
to the sequence 1, 1, 0, 0, 0, 0. In a similar way, the finite sequence 9, 1, 0, 1, 0, 1 
represents f, and 0, 0,0, 1,1, 1 represents f¢. o 


Any set with x elements can be arranged in a sequence of length n, so each 
of its subsets corresponds to a sequence of zeros and ones of length n, represent- 
ing the characteristic function of that subset. This fact allows us to represent a 
universal set in a computer as an array A of length n. Assignment of a zero or one 
to each location A[k] of the array specifies a unique subset of U. 
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Example 13. Let U = {a,b, e, g,h, r,s, w}.The array of length 8 shown in Figure 
1.16 represents U, since A[k] = 1forl=k <8. 
If S = {a, e, r, w}, then 


1 ifx = 1, 3,6,8 
f(x) = ( if x = 2,4,5,7. 


PEEP hyp] 


Figure 1.16 


Hence the array in Figure 1.17 represents the subset S. Sd 


Cfo] fofofifofr 


Figure 1.17 


A set is called countable if it is the set corresponding to some sequence. 
Informally, this means that the members of the set can be arranged in a list, with 
a first, second, third,..., element, and the set can therefore be counted. We shall 
show in Section 2.4 that all finite sets are countable. However, not all infinite sets 
are countable. A set that is not countable is called uncountable. 

The most accessible example of an uncountable set is the set of all real 
numbers that can be represented by an infinite decimal of the form 0.a,a,a;..., 
where a; is an integer and 0 <= a, = 9. We shall now show that this set is un- 
countable. We will prove this result by contradiction; that is, we will show that 
the countability of this set implies an impossible situation. (We will look more 
closely at proof by contradiction in Chapter 2.) 

Assume that the set of all decimals 0.a4,a,@, «+ - is countable. Then we could 
form the following list (sequence) containing all such decimals: 


d, = O.aya,a3°°° 
fs nie 
dy = 0.b,byb, 


_— eae 
Gz = 0.C,C2C3 


Each of our infinite decimals must appear somewhere on this list. We shall 
establish a contradiction by constructing an infinite decimal of this type that is 
not on the list. Now construct a number x as follows: x = 0.x,x,x;:-+, where x, 
is 1 ifa, = 2, otherwise x, is 2; x, = 1if b, = 2, otherwise x, = 2; x, = Lifc, = 2, 
otherwise x, = 2. This process can clearly be continued indefinitely. The resulting 
number x is an infinite decimal consisting of 1’s and 2’s, but by its construction x 
differs from each number in the list at some position. Thus x is not on the list, a 
contradiction to our assumption, Hence, no matter how the list is constructed, 
there is some real number of the form 0.x,x,x, + ++ that is not in the list. By the 
way, it can be shown that the set of rational numbers is countable. 
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Strings and Regular Expressions 


Given a set A, we can construct the set A* consisting of all finite sequences of ele- 
ments of A. Often the set A is not a set of numbers, but some set of symbols. In 
this case, A is called an alphabet, and the finite sequences in A* are called words 
from A, or sometimes strings from A. For this case in particular, the sequences in 
A* are not written with commas. We assume that A* contains the empty sequence 
or empty string, containing no symbols, and we denote this string by A. This string 
will be useful in Chapters 7 and 8. 


Example 14. Let A = {a, b, c,..., z}, the usual English alphabet. Then A* con- 
sists of all ordinary words, such as ape, sequence, antidisestablishmentarianism, 
and so on, as well as “words” such as yxaloble, zigadongdong, cya, and pqrst. All 
finite sequences from A are in A*, whether they have meaning or not. ¢ 


If wy = 545253 °°-S, and w, = ttt, --- t,, are elements of A* for some set A, 
we define the catenation of w, and w, as the sequence 515253 °* + S;fylty °-- t. The 
catenation of w, with w, is written as w, + w, and is another element of A*. Note 
that if w belongs to A*, then w+ A = w and A+ w = w. This property is conven- 
ient and is one of the main reasons for defining the empty string A. 


Example 15. Let A = {John, Sam, Jane, swims, runs, well, quickly, slowly}. Then 
A* contains real sentences such as “Jane swims quickly” and “Sam runs well,” as 
well as nonsense sentences such as “Well swims Jane slowly John.” Here we sep- 
arate the elements in each sequence with spaces. 6 


The idea of a recursive formula for a sequence is useful in more general set- 
tings as well. In the formal languages and the finite-state machines we discuss in 
Chapter 9, the concept of regular expressions plays an important role, and regu- 
lar expressions are defined recursively. A regular expression over A is a string 
constructed from the elements of A and the symbols (, ), V, *, A, according to the 
following definition. 


RE1. The symbol A is a regular expression. 

RE2. If x € A, the symbol x is a regular expression. 

RE3. If a and B are regular expressions, then the expression a is regular. 
RE4. If a and @ are regular expressions, then the expression (a V £) is regular. 
RES. If a is a regular expression, then the expression (a)* is regular. 


Note here that RE1 and RE2 provide initial regular expressions. The other 
parts of the definition are used repetitively to define successively larger sets of 
regular expressions from those already defined. Thus the definition is recursive. 

By convention, if the regular expression a consists of a single symbol x, 
where x € A, or if @ begins and ends with parentheses, then we write (a)* simply 
as a*, When no confusion results, we will refer to a regular expression over A sim- 
ply as a regular expression (omitting reference to A). 


Example 16. Let A = {0, 1}. Show that the following expressions are all regular 


expressions over A. 
(a) 0*(0 V 1)* (b) 00*(0 V 1)*1 (c) (01)*(01 V 1*) 
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Solution: (a) By RE2,0 and 1 are regular expressions. Thus (0 V 1) is reg- 
ular by RE4, and so 0* anc (0 V 1)* are regular by RES (and the conven- 
tion mentioned previously). Finally, we see that 0*(0 V 1)* is regular by 
RE3. 

(b) We know that 0, 1, and 0*(0 V 1)* are all regular. Thus, using RE3 
twice, 00*(0 V 1)*1 must be regular. 

(c) By RE3, 01 is a regular expression. Since 1* is regular, (01 V 1*) is 
regular by RE4, and (0:)* is regular by RES. Then the regularity of 
(01)*(01 V 1*) follows from RE3. Sg 


Associated with each regular expression over A is a corresponding subset 
of A*. Such sets are called regular subsets of A* or just regular sets if no refer- 
ence to A is needed. To compute the regular set corresponding to a regular 
expression, we use the following correspondence rules. 


1. The expression A corresponds to the set {A}, where A is the empty 
string in A*. 

2. Ifx € A, then the regular expression x corresponds to the set {x}. 

3. If aand fare regular expressions corresponding to the subsets M and 
N of A*, then af corresponds to M+ N = {s+ t|s © M andt € N}. Thus 
M - Nis the set of all catenations of strings in M with strings in N. 

4, If the regular expressions a and B correspond to the subsets M and N 
of A*, then a V B corresponds to M UN. 

5. If the regular expression a corresponds to the subset M of A*, then 
(a)* corresponds to the set M*, Note that M is a set of strings from A. 
Elements from M* are finite sequences of such strings and thus may 
themselves be interpreted as strings from A. Note also that we always 
have A & M*. 


Example 17. Let A = {a, b, c}. Then the regular expression a* corresponds to 
the set of all finite sequences of a’s, such as aaa, aaaaaaa, and so on. The regular 
expression a(b V c) corresponds to the set {ab, ac} C A*. Finally, the regular 
expression ab(bc)* corresponds to the set of all strings that begin with ab and 
then repeat the symbols bc n time's, where n = 0. This set includes the strings ab, 
abbcbc, abbcbcbcbe, and so on. ad 


Example 18. Let A = {0,1}. Find the regular sets corresponding to the three 
regular expressions in Example 16. 


Solution: (a) The set corresponding to 0*(0 V 1)* consists of all sequences 
of 0’s and 1’s. Thus the set is A*. 

(b) The expression 00*(0 V 1)*1 corresponds to the set of all sequences 
of 0’s and 1’s that begin with at least one 0 and end with at least one 1. 

(c) The expression (01)*(C1 V 1*) corresponds to the set of all sequences 
of 0’s and 1’s that either repeat the string 01 a total of n = 1 times or begin 
with a total of n = 0 repetitions of 01 and end with some number k = 0 of 
1’s. This set includes, for example, the strings 1111, 01, 010101, 
0101010111111, and 011. ° 


EXERCISE SET 1.3 


In Exercises 1 through 4, give the set corre- 
sponding to the sequence. 


1. 2,1,2,1,2,1,2,1 

2. 0,2, 4,6, 8, 10,... 
3. aabbccddee *-- zz 
4. abbcccdddd 


5. Give three different sequences that have 
{x, y, z} as a corresponding set. 


6. Give three different sequences that have 
{1,2,3,...} as a corresponding set. 


In Exercises 7 through 10, write out the first 


four terms (begin with n = 1) of the sequence 
whose general term is given. 


8. 6b, = 3n? + In-6 

9. c, = 2.5,¢, = ¢,-, +15 

10. d, = ~3,d, = —2d,_,+1 

In Exercises 11 through 16, write a formula for 


the nth term of the sequence. Identify your for- 
mula as recursive or explicit. 


WL. 1,3,5,7,.-- 
12. 0,3,8,15, 24, 35,... 
13. 1,-1,1,—-1,1,-1,... 
14, 0,2,0,2,0,2,... 


15. 1,4, 7, 10, 13, 16 


alr 


111 
16. 1,3,458; 


pee 
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17. Write an explicit formula for the sequence 2, 5, 
8, 11, 14, 17,.... 


18. Write a recursive formula for the sequence 2, 5, 
7,12, 19, 31,.... 


19, Let A = {x |x isa real number and 0 <x <1}, 
B = {x| xis a real number and x” + 1 = 0}, 
C = {x|x = 4m,m © Z}, D = {(x, 3) | xis an 
English word whose length is 3}, and E = 
{x |x € Z and x’ = 100}. Identify each set as 
finite, countable, or uncountable. 


20. Let A = {ab, bc, ba). In each part, tell whether 
the string belongs to A*. 
(a) ababab (b) abc (c) abba 
(d) abbcbaba (e) beabbab (f) abbbcba 


21. Let U = {FORTRAN, PASCAL, ADA, 
COBOL, LISP, BASIC, C**, FORTH}, 
B = {C**, BASIC, ADA}, C = {PASCAL, 
ADA, LISP, C**}, D = (FORTRAN, PASCAL, 
ADA, BASIC, FORTH}, and E = (PASCAL, 
ADA, COBOL, LISP, C**}. In each of the fol- 
lowing, represent the given set by an array of 
zeros and ones. 
(a) BUC (b) CND 
(d) BUE (e) CN(BUE) 


(c) BN(DNE) 


22. Let U = (b,d,e,g,h,k, m,n}, B= {b},C = 
{d, g, m,n}, and D = {d,k, n}. 
(a) What is f,(b)? (b) What is f,(e)? 
(c) Find the sequences of length 8 that corre- 
spond to fz, fc, and fp. 
(d) Represent B U C,C U D,and CN D by 
arrays of zeros and ones. 


23. Prove Theorem 1(c). 


24. Using characteristic functions, prove that 


(ADB OC=AGO(BOC). 


25. Let A = {+, X,a, 6}. Show that the following 
expressions are regular over A. 
(a) a + b{ab)*(a X b Va) 
(b) a+ bx (a* Vb) 
{c) ((a*b V +)* V X ab*) 


26. Let A = {a,b,c}. In each part we list a string in 
A* and a regular expression over A. In each 
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case, tell whether or not the string on the left 3. If X is an S-number and X is a multiple of Y, 
belongs to the regular set corresponding to the then Y is an S-number. 

regular expression on the right. Describe the set of S-numbers. 

(a) ac a*b*c 

(b) abcc (abe V c)* 29, Let F be a function defined for all nonnegative 
(c) aaabc ((a V b) V c)* integers by the following recursive definition: 
(d) ac = (a*b Vc) 

(e) abab (ab)*c F(0) = 0, FQ) = 1, 


FIN + 2) = 2F(N) + F(N +1), N=0 


Write the first six values of F; that is, write the 


at values of F(N) for N = 0, 1, 2, 3,4, 5. 


We define 7-numbers recursively as follows: 
1. Ois a T-number. 

2. If X is a T-number, X + 3 is a 7-number. 
Write a description of the set of T-numbers. 


$ 


Let G be a function defined for all nonnegative 
integers by the following recursive definition: 


G00)=1,  G(1) =2, 


28. Define an S-number by: G(N + 2) = GN)? + GIN +1), N=O 


1. 8 is an S-number. 
2. If X is an S-number and Y is a multiple of X, Write the first five values of G. 
then Y is an S-number. 


1.4. Division in the Integers 


We shall now discuss some results needed later about division and factoring in 
the nonnegative integers. If m and n are nonnegative integers and n is not zero, 
we can plot the nonnegative integer multiples of n on a half-line and locate m as 
in Figure 1.18. If m is a multiple cf n, say m = qn, then we can write m = qn +r, 
where r is 0. On the other hand (as shown in Figure 1.18), if m is not a multiple 
of , we let gn be the first multiple of n lying to the left of m and let r be m — qn. 
Then r is the distance from qu to m,so clearly 0 <r <n, and again we have m = 
qn +r. We state these observations as a theorem. 


m 
10) n 2n qn Vig + Un 


eas 2: 
r 


Figure 1.18 


Theorem 1. [fn # 0 and m are nonnegative integers, we can write m = qn +r 
for some nonnegative integers q and r with 0 = r < n. Moreover, there is just one 


way to do this. 5 
Example 1 

(a) If m is 3 and m is 16, then 16 =: 5(3) + 1,so q is 5 and ris 1. 

(b) If n is 10 and m is 3, then 3 == 0(10) + 3, so q is 0 and ris 3. ¢ 


If the r in Theorem 1 is zero, so that mm is a multiple of n, we write n | m, 
which is read “n divides m.” If rm is not a multiple of n, we write n/m, which is 
read “n does not divide m.” We now prove some simple properties of divisibility. 
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Theorem 2. Let a, b, and c be integers. 
(a) Ifa| banda c,thena|(b +c). 
(b) Ifa| band a\c, where b > c, thena|(b — c). 
(c) ifa|b ora|c,thena| be. 
(d) ifa| band b|c, thena|c. 


Proof: (a)Ifa|b and a|c, then b = k,a and c = k,a for some nonnegative 
integers k, and k, Sob +c = (k, +k,aanda (b+ c). 

(b) This can be proved in exactly the same way as part (a). 

(c) As in part (a), we have b = k,a or c = kya. Then either be = k,ac or 
bc = k,ab, so in either case bc is a multiple of a and a| be. 

(d) If a| b and b| c, we have b = k,a and c = k,b,s0 c = kb = k,(k,a) = 
(kk,)a and hence a | c. ° 


A number p > 1 in Z* is called prime if the only positive integers that 
divide p are p and 1. 


Example 2. The numbers 2,3, 5,7, 11, and 13 are prime, while 4, 10, 16, and 21 
are not prime. ¢ 


It is easy to write a set of steps, or an algorithm’, to determine if a positive 
integer n > 1 is a prime number. First we check to see if n is 2. lf n > 2, we could 
divide n by every integer from 2 to n — 1, and if none of these is a divisor of n, 
then n is prime. To make the process more efficient, we note that if mk = n, then 
either m or k is less than or equal to Vn. This means that if n is not prime, it has 
a divisor k satisfying the inequality1<A<= Vn, so we need only test for divisors 
in this range. Also, if n has any even number as a divisor, it must have 2 as a divi- 
sor. Thus, after checking for divisibility by 2, we may skip all even integers. 


Algorithm to test whether an integer N > 1 is prime: 


Step 1. Check whether N is 2. If so, N is prime. If not, proceed to 

Step 2. Check whether 2 | N. If so, N is not prime; otherwise, proceed to 

Step 3. Compute the smallest integer K = VN. Then 

Step 4. Check whether D | N, where D is any odd number such that 1 < D = K. 
If D | N, then N is not prime; otherwise, N is prime. 


Testing whether an integer is prime is a common task for computers. The 
algorithm given here is too inefficient for very large numbers, but there are many 
other algorithms for testing whether an integer is prime. 


Theorem 3. Every positive integer n > 1 can be written uniquely as 
pip... pk where p, < py <-+++ <p, are distinct primes that divide n and the 
k’s are positive integers giving the number of times each prime occurs as a 
factor of n. ¢ 


We omit the proof of Theorem 3, but we give several illustrations. 


1 Algorithms are discussed in Appendix A. 
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Example 3 

(a)9=3-3=37 

(b) 24 = 8-3 =2-2+2-3=2'+3 

(c) 30 =2+3-5 e 


Greatest Common Divisor 


If a,b, and k are in Z*,andk a, k | b, we say that k is a common divisor of a and 
b. If d is the largest such k, d is called the greatest common divisor, or GCD, of a 
and b, and we write d = GCD(a, /). This number has some interesting properties. 
It can be written as a combinatior. of a and b, and it is not only larger than all the 
other common divisors, but it is also a multiple of each of them. 


Theorem 4. /f dis GCD(a, b), then 
(a) d = sa + tb for some integers s and t (these are not both positive). 
(b) if ¢ is any other common. divisor of a and b, then c| d. 


Proof: Let x be the smallest positive integer that can be written as sa + tb 
for some integers s and ¢, and let ¢ be a common divisor of a and b. Since 
c|aandc|b, we know from Theorem 2 that ¢ | x, so c = x. If we can show 
that x is a common divisor of a and b, it will then be the greatest common 
divisor of a and b, and both parts of the theorem will have been proved. By 
Theorem 1, a = qx + rwithO =r < x. Solving for r, we have r = a — qx = 
a — q(sa + th) =a — qsa -~ qtb = (1 — qs)a + (—qn)b. If ris not zero, then 
since r < x and ris a multiple of a and a multiple of b, we will have a con- 
tradiction to the fact that x is the smallest positive number that is a sum of 
multiples of a and b. Thus r must be 0 and x/ a. In the same way we can show 
that x | b, and this completes the proof. 


Suppose now that a, b, and ¢ are in Z* and that d is a common divisor of a 
and b, which is a multiple of every other common divisor of a and b. Then d is the 
greatest common divisor of a and b. This result and Theorem 4(b) have the fol- 
lowing result: Let a,b, and d be in Z'. The integer d is the greatest common divi- 
sor of a and b if and only if 


1. dlaandd|b. . 
2. Whenever c|a@ and c| b, then c | d. 


Example 4 

(a) The common divisors of 12 and 30 are 2, 3, and 6, so GCD(12, 30) = 6 and 
6=1-304 (-2)- 12. 

(b) It is clear that GCD(17, 95) = 1 since 17 is prime and 17/95, and the reader 
may verify that 1 = 28+ 17 + (—5) +95. Sd 


If GCD(a, b) = 1, as in Example 4(b), we say that @ and b are relatively 
prime. 

One remaining question is that of how to compute the GCD conveniently 
in general. Repeated application of Theorem 1 provides the key to doing this. 
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We now present a procedure, called the Euclidean algorithm, for finding 
GCD(a, b). Suppose that a > b > 0 (otherwise interchange a and b). Then, by 
Theorem 1, we may write 


a=k,b+~r,, wherek, andr, arein Z* andO <r, < b. (1) 


Now Theorem 2 tells us that if n divides a and b, then it must divide 7,, since 7, = 
a — k,b. Similarly, if n divides b and r,, then it must divide a. We see that the 
common divisors of a and b are the same as the common divisors of b and r,, so 
GCD(a, b) = GCD(#, r,). 

We now continue using Theorem 1 as follows: 


divide b by r,: b=kyr, +h 0=n<r, 
divide 7, by 7,: r=kynt+r 0=174<1 
divide r, by 73: Ty = Kary + 14 O=n<r, Q) 
divide r,,_5 by r,_4: Ty—2 = Kalai + a Os7,<%-1 
divide r,_, by r,,: Thy = Kaan tna. OS Mal < 
Sincea > b> 1, >> 7; > 74> +++, the remainder will eventually become zero, 


so at some point we have 7,,,, = 0. 
We now show that r, = GCD(a, b). We saw previously that 


GCD(a, b) = GCD(b, r,). 
Repeating this argument with b and r,, we see that 
GCD(b, r,) = GCD(r,, 72). 
Upon continuing, we have 
GCD(a, b) = GCD(b, r,) = GCD(,, 7.) = --- = GCD(r,,_1,7,) 
Since r,,_; = k, 41%, We see that GCD(r,,_,,7,) = 7, Hence r, = GCD(a, b). 


Example 5. Let a be 190 and b be 34. Then, using the Euclidean algorithm, we 
divide 190 by 34: 190 = 5-34 + 20 


divide 34 by 20: 34=1-20+ 14 
divide 20 by 14: 20=1-14+6 
divide 14 by 6: 14=2-6+2 
divide 6 by 2: 6=3-2+0. 
so that GCD(190, 34) is 2, the last of the divisors. ¢ 


In Theorem 4(a), we observed that if d = GCD(a, b), we can find integers s 
and ¢ such that d = sa + tb. The integers s and t can be found as follows. Solve the 
next-to-last equation in (2) for r,: 


| cd Pe ae See (3) 
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Now solve the second-to-last equation in (2), r,_3; = k,_4",-2 + 1,—1 for 


Thev 


Ma-1 ~ n-3 ky—Wn-2- 
Substitute this expression in (3): 


Th = Fy K,[rn-3 = k,-n-2]- 


Continue to work up through the equations in (2) and (1), replacing 7, by an 
expression involving 7,_, and 7,_, and finally arriving at an expression involving 
only a and b. 


Example 6. (a) Let a = 190 and b = 34 as in Example 5. Then 
GCD(190, 34) = 2 = 14 ~ 2(6) 


= 14 ~ 2/20 - 1(14)] 6=20-1-14 
= 3(14) - 2(20) 
= 3[34 — 1(20)] — 2(20) 14 = 34—1-20 


= 3(34) — 5(190 ~ 5-(34)) 20=190-—5-34 
= 28(34) - 5(190). 


Hence s = —5 and t = 28. Note that the key is to carry out the arithmetic only 
partially. 
(b) Let a = 108 and b = 60. Then 


GCD(108, 60) = 12 = 60 — 1(48) 
= 60 — .[108 — 1(60)] 48 = 108 — 1-60 
= 2(60) ~ 108. 


Hence s = —1 andt = 2. Sd 
Theorem 5. [fa and bare in Z', then GCD(a, b) = GCD(b, b + a). 


Proof: If c divides a and +, it divides b + a, by Theorem 2. Since a = 
b — (b — a) = —b + (b + 4), we see, also by Theorem 2, that a common 
divisor of b and b + a also divides a and b. Since a and b have the same 
common divisors as 6 and f= a, they must have the same greatest common 
divisor. Sd 


Least Common Multiple 


Ifa,b,andkarein Z*,anda k,b | k, we say k is a common multiple of a and b. 
The smallest such k, call it c, is called the least common multiple or LCM, of a 
and b, and we write c = LCM(a, l:). The following result shows that we can obtain 
the least common multiple from the greatest common divisor, so we do not need 
a separate procedure for finding the least common multiple. 


Theorem 6. [fa and b are two positive integers, then GCD(a, b) » LCM(a,b) = ab. 
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Proof: Let p,,p>,...,p, be all the prime factors of either a or b. Then we 
can write 


a= Pr'p?? aie + Pye and b= phipke ft - pee 
where some of the a; and b; may be zero. It then follows that 
GCD(a, b) = pins bi) min (az, bz). « +p nin@e by) 
and 
LCM(a, b) = py Ter bp max (an by)... + pT lar, bx). 
Hence 
GCD(a, b) - LCM(a, b) = pit *?ip,*?2- +> pga? 
= (pip? Pe) + Or? +: pe’) 
= ab. 5 


Example 7. Let a = 540 and b = 504, Factoring a and b into primes, we obtain 
a= 540 = 2?-33-5 and b= 504 = 23-3?-7. 
Thus all the prime numbers that are factors of either a or b are p, = 2, py = 3, 
Pp; = 5, and p, = 7.Then a = 2? + 33+ 5!» 7° and b = 23 - 3° - 5°+ 7'. We then have 
GCD(540, 504) = 2min@.3) , 3min@,2) , 5min(1, 0) , 7min(0, 1) 

= 22.37.59. 79 

=2?.3* or 36. 
Also, 

LOM(540, 504) = 272"2:3) . 3max@.2).- Smax(, 0), 7max(0, 1) 
= 23.33.5!.7! or 7560. 

Then GCD(540, 504) + LCM(540, 504) = 36 - 7560 = 272,160 = 540 - 504. As a 


verification, we can also compute GCD(540, 504) by the Euclidean algorithm and 
obtain the same result. ° 


Ifa # 0 and b are nonnegative integers, Theorem 1 tells us that we can write 
b = qa+r,0 <r <a. Sometimes the remainder r is more important than the 
quotient g. Note thatO =r<a. 


Example 8. If the time is now 4 o’clock, what time will it be 101 hours from 
now? 


Solution: Let a = 12 and b = 4 + 101, or 105. Then we have 105 = 
8+ 12 + 9. The remainder 9 answers the question. In 101 hours it will be 
9 o’clock. ° 


In this case we call a the modulus and write b = r (mod a), read “b is con- 
gruent to r mod a.” 
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Example 9 

(a) 29 = 4 (mod 5), since 29 = 5+5 + 4. 

(b) 172 = 7 (mod 11), since 172 == 15+ 11 + 7. 

(c) 3 = 3 (mod 6), since 3 = 0-6 + 3. Sd 


Note that if b =r (mod a), then 0 = r < a, and b — ris a multiple of a; that 
is, a divides b ~—r. 

For each n € Z*, we define a function f,, the mod-n function, as follows: If 
z is a nonnegative integer, then j/,(z) = r, where z =r (moda) and0 =r < xn. 
(Again, functions are formally defined in Section 5.1, but, as in Section 1.3, we 
need only think of a function as a rule that assigns some “value” to each member 
of a set.) 


Example 10 
(a) f,(14) = 2, because 14 = 4-3 + 2 and 14 = 2 mod 3. 
(b) f,(153) = 6 ° 


Pseudocode Versions 


An alternative to expressing an algorithm in ordinary English, as we did previ- 
ously in this section, is to express it in something like a computer language. 
Throughout the book we use a pseudocode language, which is described fully in 
Appendix A. Here we give pseudocode versions for an algorithm that determines 
if an integer is prime and for an algorithm that calculates the greatest common 
divisor of two integers. 

In the pseudocode for the algorithm to determine if an integer is prime, we 
assume the existence of functions SQR and INT, where SQR(N) returns the 
greatest integer not exceeding VN, and INT(X) returns the greatest integer not 
exceeding X. For example, SQR(10) = 3, SQR(25) = 5, INT(7.124) = 7, and 
INT(8) = 8. 


SUBROUTINE PRIME(N) 
1. IE (N = 2) THEN 
a. PRINT (‘PRIME’) 
b. RETURN 
2. ELSE 
a. IF (N/2 = INT(N/2)) THEN 
1. PRINT (‘NOT PRIME’) 
2. RETURN 
b. ELSE 
1. FOR D = 3 THRU SOR(N) BY 2 
a. IF (N/D = INT (N/D)) THEN 
1. PRINT (‘NOT PRIME’) 


2. RETURN 
2. PRINT (‘PRIME’) 
3. RETURN 


END OF SUBROUTINE PRIME 
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The following gives a pseudocode program for finding the greatest common 
divisor of two positive integers. This procedure is different from the Euclidean 
algorithm, but in Chapter 2 we will see how to prove that this algorithm does 
indeed find the greatest common divisor. 


FUNCTION GCD(X, Y) 
1. WHILE (X + Y) 
a. IF (X > Y) THEN 


1 Xe X-Y 
b. ELSE 
1.¥eY-X 
1. RETURN (X) 


END OF FUNCTION GCD 


Example 11. Use the pseudocode for GCD to calculate the greatest common 
divisor of 190 and 34 (Example 5). 


Solution: Table 1.1 gives the values of X, Y, X — Y, or Y — X as we go 


through the program. 
Table 1.1 
xX Y x-Y Y-X 
190 34 156 
156 34 122 
122 34 88 
88 34 54 
54 34 20 
20 34 14 
20 14 6 
6 14 8 
6 8 2 
6 Z 4 
4 2 2 
2 2 


Since the last value of X is 2, the greatest common divisor of 190 and 34 


is 2. ¢ 
EXERCISE SET 1.4 
In Exercises 1 through 4, for the given integers 5. Write each integer as a product of powers of 
mand n, write mas qn +r, withO=r<n. primes (as in Theorem 3). 


(a) 828 — (b) 1666 (c) 1781 


1. m= 20, n =3 2. m = 64, n = 37 (d) 1125 (e) 107 


3. m= 3,n = 22 4. m= 48, n = 12 
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In Exercises 6 through 9, find the greatest com- 
mon divisor d of the integers a and b, and write 
das sa + tb. 


6. a= 60,b=100 7. a= 45, b = 33 
8 a=34,b=58 9% a=77,b = 128 


In Exercises 10 through 13, find the least com- 
mon multiple of the integers. 


17. 


18. 


19. 


20. 


Show that if GCD(a,c) = 1 and c| ab, then c |b. 


Show that if GCD(a, c) = 1,a|m,andc|m, 
then ac | m. (Hint: Use Exercise 17.) 


Show that if d = GCD(a, b), a 
ac | bd. 


b, and c | d, then 


Show that GCD(ca, cb) = c GCD(a, b). 


21. Show that LCM(a, ab) = ab. 
10. 72, 108 11. 150,70 
22. Show that if GCD(a, b) = 1, then LCM(a, b) = 
12, 175, 245 13. 32,27 ab. 
14. If fis the mod-7 function, compute each of the 23. Let c = LCM(a, b). Show that if a| k and b | k, 
following. then c|k. 
(a) f7) ss (b) f(48)—() f(1207) 
(d) F430) (e) f(93)—f) F169) 24. Prove that if a and b are positive integers such 
that a| b and b | a, then a = b. 
15. If g is the mod-6 function, solve each of the fol- 
lowing. p Be 8 
25. Let a be an integer and let p be a positive inte- 
(a) gin) =3 (Bb) gin) =1 4 Ge 


16. Let a and b be integers. Prove that if p is a 
prime and p | ab, then p | @ or p | b. (Hint: If 
pfa,then 1 = GCD(a, p); use Theorem 4 to 
write 1 = sa + tp.) 


1.5. Matrices 


ger. Prove that if p | a, then p = GCD(a, p). 


A matrix is a rectangular array of numbers arranged in m horizontal rows and n 
vertical columns: 


Qyy Ay Ny, 

a a a 
= a x2 Qn 
any Aang nn 


The ith row of Ais (a, dp °-* |, 1S i<m,and the jth column of A is | “” ], 


1 <j <n. We say that A is mby n, written as m X n. If m =n, we say A is a square 
matrix of order n and that the numbers a@,,,@y,...,4,, form the main diagonal of 
A. We refer to the number dip which is in the ith row and jth column of A, as the 
i,jth element of A or as the (i,j) entry of A, and we often write (1) as A = [a,]. 
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Example 1. Let 


~1 1 0 -1 
D= 21], and E=}-1 2 3]. 
t) 2 4 5 


Then A is 2 X 3 with a,. = 3 and a,, = 2, Bis 2 X 2 with b,, = 4, Cis 1 x 4,D 
is 3 X 1, and Eis 3 X 3. . 4 


A square matrix A = [a,] for which every entry off the main diagonal is 
zero, that is,a,; = 0 fori # j, is called a diagonal matrix. 


Example 2. Each of the following is a diagonal matrix. 


2 
4 0 aie 
F= eS G={0 -3 O}. 
0 0 5 o 
Matrices are used in many applications in computer science, and we shall 
see them in our study of relations and graphs. At this point we present the fol- 


lowing simple application showing how matrices can be used to display data in a 
tabular form. 


Example 3. The following matrix gives the airline distances between the cities 
indicated. 


London Madrid NewYork Tokyo 


London 0 785 3469 5959 

Madrid 785 0 3593 6706 

New York 3469 3593 0 6757 
Tokyo 5959 6706 6757 0 2 


Two m X n matrices A = [a;] and B = [b,] are said to be equal if a; = 6 
1sism,1sj <n, that is, if corresponding elements are the same. 


Pp 


20 33, = 1 2 x —-1 

Example4. If A= {0 5 2tandB=]y 5  21,thenA = Bifand 
4 -4 6 4 -4 2 

only if x = —3, y =0,and z = 6. °° 


If A = [a,] and B = [5,] are m X n matrices, then the sum of A and B is the 
matrix C = [c,] defined by ¢, = a; + by 1 Sis m,1 <j <n.Thatis, Cis obtained 
by adding the corresponding elements of A and B. 


NS A od —/4 5 3 
Example 5. tata [3 0 3] nae = [5 3 3 | then 
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+ 4+ -1+ 
a+e-|! 4 4+5 1 \-L 9 ik 


5+0 O0+(-3) -2+2 ce + 


Observe that the sum of the: matrices A and B is defined only when A and 
B have the same number of rows and the same number of columns. We agree to 
write A + B only when the sum is defined. 

A matrix all of whose entries are zero is called a zero matrix and is de- 
noted by 0. 


Example 6. Each of the following is a zero matrix. 
in i f 0 4] : : ; 
0 0 0 0 0 00 0 


The following theorem gives some basic properties of matrix addition; the 
proofs are omitted. 


Sd 


Theorem 1 
(a) A+B=B+A. 
(b) (A+ B)+C=A+ (B+ C). 
()A+0=0+A=A. 5 


If A = [a,] is an m X p matrix and B = [b,] is a p X n matrix, then the prod- 
uct of A and B, denoted AB, is the m X n matrix C = [c,] defined by 


Cy = Gb, + Agby +--+ + aiyby;, 1sism,1sjsn. (2) 


Let us explain (2) in more detail. The elements a,,,4;9,...,4,, form the ith row of 
A, and the elements by, b,,,...,.5,, form the jth column of B. Then (2) states that 
for any i and j the element c; of C = AB can be computed in the following way 
(see Figure 1.19). 


1. Select row i of A and column j of B and place them side by side. 
2. Multiply corresponding entries and add all the products. 


2 3 -~4 


E le 7. Li = 
xample et A f * 3 


(DGB) + 2)G2) + B)G) (A) + 22) + B)C3) 
_[-20 20 
~| 14 -47 + 


An array of dimension two is a modification of the idea of a matrix, in the 
same way that a linear array is a raodification of the idea of a sequence. By an 


ae ee + (3-2) + 495) @)(1) + BQ) + ey 
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Din Ci eg Cin 

bon Ca, €29 Con 
“y 

bon mi ©m2 mn 


Multiply corresponding 
elements together and 
add the results to 


form Cj 


Figure 1.19 


m X narray A we will mean an m X n matrix A of positions. We may assign num- 
bers to these positions later, make future changes in these assignments, and still 
refer to the array as A. This is a model for two-dimensional storage of informa- 
tion in a computer. The number assigned to row / and column j of an array A will 
be denoted Az, /]. 

As we saw earlier, the properties of matrix addition resemble the familiar 
properties for the addition of real numbers. However, some of the properties of 
matrix multiplication do not resemble those of real number multiplication. First, 
observe that, if A is an m X p matrix and B is a p X n matrix, then AB can be 
computed and is an m X n matrix. As for BA, we have the following four possi- 
bilities: 

1. BA may not be defined; we may have n # m. 

2. BA may be defined and then BA is p X p, whereas AB is m X m and 

p # m.Thus AB and BA are not equal. 
3. AB and BA may both be the same size, but not be equal as matrices. 
4. AB = BA. 


We agree as before to write AB only when the product is defined. 


= 4 “— 
Example 8. Let A= b | and B = E ZI Then AB = | | 


3-2 2 3 -1 3 
-1 3 
and BA = E al 
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The basic properties of rnatrix multiplication are given by the following 
theorem. 


Theorem 2 
(a) A(BC) = (AB)C. 
(b) A(B + C) = AB + AC. 


(c) (A + B)C = AC + BC. 5 
The n X n diagonal matrix 
1 0 0 
leases 
00 -. 4 


all of whose diagonal elements are 1, is called the identity matrix of order n. If A 
is an m X n matrix, it is easy to verify that L,A = Al, = A. If Ais ann X n matrix 
and p is a positive integer, we define 
A’=A-A---A and A°=1, 
—— 
p factors 

If p and q are nonnegative integers, we can prove the following laws of exponents 
for matrices: 


A’AT = APT and (A?)? = APA, 
Observe that the rule (AB)? =- A’ B? does not hold for square matrices. However, 
if AB = BA, then (AB) = A?B’. 
If A = [a,] is an m X n matrix, then the n X m matrix AT= [aj]. where 
ay =a4;,1=i=m,1=j <n,1is called the transpose of A. Thus the transpose of 
A is obtained by interchanging the rows and columns of A. 


27-305 3 4 5 
Example 9. Let A= E 1 | and B=]2 -1 0}. Then 
1 6 -2 
2 6 3 2 1 
A’=]-3 1]andB’=]4 -1 6}. 
5 3 5 0 ~2 
The following theorem summarizes the basic properties of the transpose 
operation. 
Theorem 3. 7f A and B are matrices, then 
(a) (AT)? = A. 
(b) (A + B)? = AT + BY 
(c) (AB)? = BTA’. a 


A matrix A = [a,] is called symmetric if A” = A. Thus, if A is symmetric, 
it must be a square matrix. It is easy to show that A is symmetric if and only if 


a; = a; That is, A is symmetric if and only if the entries of A are symmetric 
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with respect to the main diagonal of A. 


1 2..=3 1 2. <3 

Example 10. If A= 2 4 5|/and B=] 2 4 0|,then A is 
=3> 5 6 3 2 1 

symmetric and B is not symmetric. ¢ 


Boolean Matrix Operations 


A Boolean matrix is an m X n matrix whose entries are either zero or one. We 
shall now define three operations on Boolean matrices that have useful applica- 
tions in Chapter 4. 

Let A = [a;] and B = [b,] be m X n Boolean matrices. We define A V B = 
C = [c,], the join of A and B, by 


eit 1 ifa, = 1orb;=1 
: 0 if a; and 5; are both 0. 
and A /\ B = D = [d,], the meet of A and B, by 
Cam 1 if@, and bare both 1 
"(0 ifa; = Oor b, = 0. 
Note that these operations are only possible when A and B have the same size, 
just as in the case of matrix addition. Instead of adding corresponding elements 


in A and B, to compute the entries of the result, we simply examine the corre- 
sponding elements for particular patterns. 


1 0 1 1 1 0 
011 1 0 1 
Example 11. Let A = 110 and B = 001 
0 0 0 1 1 0 


(a) Compute A VB. (b) Compute AA B. 


Solution: (a) Let A V B = [e,]. Then, since a,, and b,, are both 0, we see 
that c,; = 0. In all other cases, either a, or b; is 1, so c, is also 1. Thus 


1 11 
111 

A a 
ME 111 
1 1 0 


(b) Let A \B = [d,]. Then, since a,, and 6,, are both 1, d,, = 1,and since 
ay, and by, are both 1, d,, = 1. In all other cases, either a, or b, is 0,80 d, = 0. 


Thus 


AAB= 


ooor 
ooo o 
ooro 
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Finally, suppose that A = |a,] is an m x p Boolean matrix and B = [b,] isa 
P X n Boolean matrix. Notice that the condition on the sizes of A and B is ex- 
actly the condition needed to form the matrix product AB. We now define 
another kind of product. 

The Boolean product of A and B, denoted A © B, is the m X n Boolean 
matrix C = [c,] defined by 


eed 1 ifa, = 1andb, = 1forsomek,l=k sp 
7 lO otherwise. 


This multiplication is similar tc ordinary matrix multiplication. The preceding 
formula states that for any i and j the clement c, of C = A © B can be comput- 
ed in the following way (see Figure 1.20 and compare this with Figure 1.19). 


1. Select row i of A and cchamn j of B, and arrange them side by side. 
2. Compare corresponding entries. If even a single pair of corresponding 
entries consists of two 1’s, then c,; = 1. If this is not the case, then c; = 0. 


ln “1 12 ln 
by, a1 &29 Con 
Don Cm Cnn 


If any corresponding pair 
of entries are both 
equal to 1, then oy = 1; 


otherwise oy = 0 


Figure 1.20 


We can easily perform the indicated comparisons and checks for each posi- 
tion of the Boolean product. Thus, at least for human beings, the computation of 
elements in A © B is considerably casier than the computation of elements in AB. 
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1 1 0 
010 1 00 0 

Example 12. Let A = c 46 andB=]0 1 1 Of. Compute A OB. 
001 1011 


Solution: Let A © B = [e,]. Then e,, = 1, since row 1 of A and column 1 
of B each have a 1 as the first entry. Similarly, e,, = 1, since a,, = 1 and 
by, = 1; that is, the first row of A and the second column of B have a 1 in 
the second position. In a similar way we see that e,, = 1. On the other hand, 
€14 = 0, since row 1 of A and column 4 of B do not have common 1’s in any 
position. Proceeding in this way, we obtain 


1 1 1 0 
0 11 0 
AOB= a ae | 
1011 Sd 


The following theorem, whose proof is left as an exercise, summarizes the 
basic properties of the Boolean matrix operations just defined. 


Theorem 4. Jf A, B, and C are Boolean matrices of compatible sizes, then 
1. (a) AVB=BVA. 
(b) ANB=BAA. 
2. (a) (AV B)VC=AV (BV ©). 
(b) (AAB)AC=AA (BAC). 
3. (a) AN (BV ©) =(AAB V(AAC). 
(b) AV (BAC) = (AVB)A(AV ©). 


4, (AOC B)OC=A0O(BOC). Sd 
EXERCISE SET 1.5 
3 3 0 0 
1. taa=(} = Al =|-2], and @a=[ ;| (b)B=|0 -2 0 
4 0 0 5 
2 3 4 0 0 0 
C=|5 6 -1 (c) C=|}0 0 O 
2 0 8 9 0 0 
(a) What is @,, a), 3? 2 —2 
(b) What is 6,,, 83, (d)D=]0 -1 0 
(c) What is €,3, Cy3, C33? 0 3 
(d) List the elements on the main diagonal 
of C. pect 
(e)E=]0 4 0 
0 0 4 


2. Which of the following are diagonal matrices? 
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3. 


4. 
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a+b ctd 4 6 
= ind 
ufone Ff a a, b,c, 
and d. 


a+2b 2a-b 4-2). 
ee el 3 tina bs 


and d. 


In Exercises 5 through 10, let 


10. 


11. 


2 1 -1 
. Leta =|? 3 fone =| 3 


0 1 
ae le 
2 3 
1-2 3 
c=|4 2 s|.o-("3 A 
3 1 2 
3 2-1 
E=|5 4 -3 sand P= | ; |. 
0 1 2 


. If possible, compute each of the following. 


(a) C+E 
(c) CB+F 


(b) AB and BA 
(d) AB + DF 


. If possible, compute each of the following. 


(a) A(BD) and (AB)D 
(b) A(C + E) and AC + AE 
(c) FD + AB 


. If possible, compute each of the following. 


(a) EB+ FA 
(c) (F+D)A 


(b) A(B + D) and AB + AD 
(d) AC + DE 


. If possible, compute each of the following. 


(a) AT and (AT)? 
(c) (AB)’ and B’A? 


(b) (C+ E)’ and C? + E” 
(d) (B°C) + A 


. If possible, compute each of the following. 


(a) A(D + BE) 
(c) (B' + AC 


(b) (BC)? and CB" 
(d) (D" + E)F 


Compute D*. 


Let A be an m X n matrix. Show that I, A = 
Al, =A. 


2 
i . Show 
that AB # BA. 


13. 


14. 


15. 


16. 


17. 


3 0 0 
LetA=]0 -2 Of. 
0 0 4 


(a) Compute A*, —_ (b) What is A’? 


Show AO = 0 for any matrix A. 
Show that I! = I. 


(a) Prove that if A has a row of zeros, then AB 
has a corresponding row of zeros. 

(b) Prove that if B has a column of zeros, then 
AB has a corresponding column of zeros. 


Show that the jth column of the matrix product 
AB is equal to the matrix product AB,, where 
B, is the jth column of B. 


‘t8. If 0 is the 2 X 2 zero matrix, find two 2 x 2 


19, 


22. 


23. 


24. 


matrices A and B, with A # 0 and B # 0, such 
that AB = 0. 


0 1 
IfA = ? p |: sow tat A? =]. 


. Determine all 2 x 2 matrices A = FE "| 


such that A’ = I. 


- Let A and B be symmetric matrices. 


(a) Show that A + B is also symmetric. 
(b) Is AB also symmetric? 


Let A be ann X n matrix. 
(a) Show that AA’ and A‘A are symmetric. 
(b) Show that A + A’ is symmetric. 


Prove Theorem 3. [Hint: For part (c), show that 
the i,jth element of (AB)’ equals the i, jth ele- 
ment of BA’] 


In each part, compute A V B, AB, and 
A ©B for the given matrices A and B. 


10 tt 
acto ik e-fo a] 
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ee 0 0 26. (a) Show that AV B=BV A. 
I B-| | (b) Show that AA B=BAA. 


11 ‘56 27. (a) Show that A V (BV C) = (AV B) VC. 

| B-| | (b) Show that AA (BAC) = (AAB)AC. 

(c) Show that A © (BOC) = (AQB)OC. 

. (a) Show that A A (BV C) = (AAB)V 
(AAC). 

(b) Show that A V (BAC) = (AV B)A 
(AV C). 


o 
- © 
oO 
co 


an 
= 
—) 
a 
I 
an 
mn 


29. Let A = [a,] and B = [b;] be two n X n matri- 
ces, and let C = [c,] represent AB. Prove that 
if k is an integer and k | a, for all i, j, then 


100 1141 ke | ¢, for all i,j. 


o 
= 
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101 100 30. Let p be a prime number with p > 2, and let 

A and B be matrices all of whose entries are 

integers. Suppose that p divides all the entries 

of A + B and all the entries of A — B. Prove 

25. (a) Show that AVA=A. that p divides all the entries of A and all the 
(b) Show that AA A= A. entries of B. 


1.6. Mathematical Structures 


A situation we have seen several times in this chapter, and will see many more 
times in later chapters, is the following. A new kind of mathematical object is 
defined, for example, a set or a matrix. Then notation is introduced for repre- 
senting the new type of object, and a way to determine whether two objects are 
the same is described. Usually, the next topic is ways to classify objects of the new 
type, for example, finite or infinite for sets, and Boolean or symmetric for matri- 
ces. Then operations are defined for the objects and the properties of these oper- 
ations are examined. 

A collection of objects with operations defined on them and the accompa- 
nying properties form a mathematical structure or system. In this book we deal 
only with discrete mathematical structures. 


Example 1. The collection of sets with the operations of union, intersection, and 
complement and their accompanying properties is a (discrete) mathematical 
structure. We denote this structure by [sets, U,M, ~ J. od 


Example 2. The collection of 3 X 3 matrices with the operations of addition, 
multiplication, and transpose is a mathematical structure that is denoted by 
[3 x 3 matrices, +, *, 7]. o 
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An important property we have not identified before is closure. A structure 
is closed with respect to an operation if that operation always produces another 
member of the collection of objects. 


Example 3. The structure [5 * 5 matrices, +, +, 7] is closed with respect to addi- 
tion because the sum of two 5 X 5 matrices is another 5 X 5 matrix. 4 


Example 4. The structure [odd integers, +, +] is not closed with respect to addi- 
tion. The sum of two odd integers is an even integer. This structure does have the 
closure property for multiplication, since the product of two odd numbers is an 
odd number. . 


An operation that combines two objects is a binary operation. An operation 
that requires only one object is « unary operation. Binary operations often have 
similar properties, as we saw earlier. 


Example 5 

(a) Set intersection is a binary operation, since it combines two sets to produce 
a new set. 

(b) Producing the transpose of a matrix is a unary operation. Sd 


Common properties have been given names. For example, if the order of 
the objects does not affect the outcome of a binary operation, we say that oper- 
ation is commutative. That is, if x 0 y = y Ox, where L is some binary operation, 
Cis commutative. 


Example 6 
(a) Join and meet for Boolean matrices are commutative operations. 


AVB=BVA and AAB=BAA. 


(b) Ordinary matrix multiplication is not a commutative operation. AB # BA. 
. 


Note that when we say ar operation has a property this means that the 
statement of the property is true when the operation is used with any objects in 
the structure. If there is even one case when the statement is not true, the opera- 
tion does not have that property. 

If O is a binary operation, then LH is associative or has the associative prop- 
erty if 


@wOvyOz=xO(yO2z). 


Example 7. Set union is an associative operation, since (A U B) UC = 
AU (BU C) is always true. a 


If a mathematical structure has two binary operations, say LD and V, a dis- 
tributive property has the following pattern: 


sO Vz2= GOVE 


Zz). 
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Example 8 

(a) We are familiar with the distributive property for real numbers; if a, b, and c 
are real numbers, then a-(b + c) =a-6 + ac. Note that, because we have 
an agreement about real number arithmetic to multiply before adding, 
parentheses are not needed on the right-hand side. 

(b) The structure [sets, U,M, ] has two distributive properties. 


AU(BNC)=(AUB)N(AUC) 
and 
AN (BUC) =(ANB)U(ANC). Sd 
Several of the structures we have seen have a unary operation and two 
binary operations. For such structures we can ask whether De Morgan’s laws are 


properties of the system. If the unary operation is * and the binary operations are 
O and V, then De Morgan’s laws are 


(xOy)*=x*Vy* and (Vy)* =x*Oy*. 


Example 9 

(a) As we saw in Section 1.2, sets satisfy De Morgan’s laws for union, intersec- 
tion, and complement: (A N B) = AUB and (AUB) = ANB. 

(b) The structure [real numbers, +, +, ] does not satisfy De Morgan’s laws, 


since Vx + y #Vx% Vy. Sg 


A structure with a binary operation 0 may contain a distinguished object, 
e, with the property x Ce = e Lx = x. We call e an identity for L. In fact, an iden- 
tity for an operation must be unique. 


Theorem 1. /f e is an identity for a binary operation LU, then e is unique. 


Proof: Assume another object i also has the identity property, so x Oi = 
iO x = x. Then e 0 i = e; but since e is an identity for ,iOe=eOi=i. 
Thus i = e. There is at most one object with the identity property for O. @ 


Example 10. For the structure [n X n matrices, +, *, 7], I, is the identity for 
matrix multiplication, and the m X n zero matrix is the identity for matrix addi- 
tion. ° 


If a binary operation U1 has an identity e, we say that y is a LJ-inverse of x if 
xOy=yOx=e. 


Theorem 2. /f C1 is an associative operation and x has a C-inverse y, then y is 
unique. 


Proof: Assume that there is another L-inverse for x, say z. Then 
ZOxOy=eOy=yandz0 Oy) = ze = z. Since 0 is associa- 
tive, (zg Ox) Oy =zO WO y), andsoy = z. o 


Example 11 
(a) In the structure [3 x 3 matrices, +, *, 7], each matrix A = [a,] has a 
+-inverse, or additive inverse, -A = [—a,]. 
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(b) In the structure [integers, +,~], only the integers 1 and —1 have multiplica- 


tive inverses. 


¢ 


Example 12. Let 0, V, and * be defined for the set {0, 1} by the following tables: 


O}0 1 Vio 1 
0,0 1 0;0 90 
1/1 0 1/0 1 


Thus 1010 = 1,0 V 1 = 0, and L* = 0. 

Determine if each of the following is true for [{0, 1}, 
(a) U is commutative. 

(b) V is associative. 

(c) De Morgan’s laws hold. 


x | x 
0| 1 
1| 0 


O, Vv, *). 


(d) Two distributive properties hold for the structure. 


Solution: (a) The statement x 0 y = y Ox must be true for all choices of 
x and y. Here there is only one case to check: Is0U1=10 


both 0 0 1 and 100 are 1, 0 is commutative. 


0 true? Since 


(b) The eight possible cases to be checked are left as an exercise. See 


Exercise 4(b). 

(c) (000)* = 0* = 1 o*V0F=1V 1 
(0O1)*=1*=0 OFV1*=1V0 
(101)* =0*=1 1*V1*=0V0 


=1 
=0 
=0. 


The last pair shows that De Morgan’s laws do not hold in this structure. 


(d) One possible distributive property is x 0 


(y Vz) = 


yy Ve 


lz). 


We must check all possible cases. One way to organize this is shown in Table 


1.2. 


Table 1.2 


Wve x 


xyz V Oo Oo 
000 0 aD) 0 0 0 
001 0 a) 0 1 0 
010 0 J 1 0 0 
011 1 i 1 1 1 
100 0 1 1 1 1 
101 0 1 1 0 0 
110 0 1 0 1 0 
111 1 t) 0 0 0 
(A) (B) 


Since columns (A) and (B) are not identical, this possible distributive 
property does not hold in this structure. The check for the other distributive 


property is Exercise 5. 


a 


In later sections, we will find it useful to consider mathematical structures 
themselves as objects and to classify them according to the properties associated 


with their operations. 


EXERCISE SET 1.6 


1, In each part, tell whether the structure has the 
closure property with respect to the operation. 
(a) [sets, U,N, 7] union 

(b) [sets, U,N,7] complement 

(c) [4 x 4 matrices, +,*,7] multiplication 
(d) [3 < 5 matrices, +,*,7] transpose 


2. In each part, tell whether the structure has the 
closure property with respect to the operation. 
(a) [integers, +, —, *, +] division 
(b) [A*, catenation] catenation 
(c) [n X n Boolean matrices, V,\,7] meet 
(d) [prime numbers, +, *] addition 


3. Prove that @ is a commutative operation for 
sets. 


4. Using the definitions in Example 12, (a) prove 
is associative. (b) Prove that V is associative. 


5. Using the definitions in Example 12, determine 
if the other possible distributive property holds. 


6. Give the identity element, if one exists, for each 
binary operation in the given structure. 
(a) [real numbers, +, *, Vv] 
(b) [sets, LU, ,7] 
(c) [{0, 1], 0, V, *] as defined in Example 12 
(d) [subsets of a finite set A, @, —] 


7. Give the identity element, if one exists, for each 
binary operation in the structure [5 x 5 Boolean 
matrices, V, A, ©]. 


In Exercises 8 through 14, use the structure S = 
[n X n diagonal matrices, +, *, 7]. 


8. Prove that S$ is closed with respect to addition. 


KEY IDEAS FOR REVIEW 


@ Set: a well-defined collection of objects 
@ © (empty set): the set with no elements 
@ Equal sets: sets with the same elements 


4 ACB (Aisa subset of B): Every element of A 


is an element of B. 
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9. Prove that S is closed with respect to multipli- 
cation. 


10. Prove that S is closed with respect to the trans- 
pose operation. 


11. Does S have an identity for addition? If so, 
what is it? 


12. Does S have an identity for multiplication? If 
so, what is it? 


13. Let A be ann X n diagonal matrix. Describe 
the additive inverse of A. 


14. Let A be an n X n diagonal matrix. Describe 
the multiplicative inverse of A. 


In Exercises 15 through 20, use the structure 
R = ([M, +, *, 7], where M is the set of matrices 


of the form k OI ais areal number. 


0 
15, Prove that R is closed with respect to addition. 


16. Prove that R is closed with respect to multipli- 
cation. 


17, Prove that R is closed with respect to the trans- 
pose operation. 


18. Does R have an identity for addition? If so, 
what is it? 


19. Does R have an identity for multiplication? If 
so, what is it? 


20. Let A be an element of M. Describe the addi- 
tive inverse for A. 


@ |A| (cardinality of A): the number of elements 


of A 


@ Infinite set: see page 4 
# P(A) (power set of A): Set of all subsets of A 
@ AU B (union of A and B): {x| x € A or x € B} 
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AB (intersection of A and B): {x |x € A and 
x € B} 

Disjoint sets: two sets with no elements in com- 
mon 

A — B (complement of B with respect to A): 
{x|x € A and x € B} 

‘A (complement of A): {x |x € A} 

Algebraic properties of set operations: see page 
9 

Theorem (the addition principle): If A and B 
are finite sets, then |A U B) = |A| + |B| - 
|AN Bl. 

Theorem (the three-set addition principle): If 
A, B, and C are finite sets, then 


|AUB UC|=|A| + |B) + |C| - |ANB| 
-|ANc|-|BNC|+/ANBNC 


Sequence: list of objects in a definite order 
Recursive formula: a formula that uses previ- 
ously defined terms 

Explicit formula: a formula that does not use 
previously defined terms 

Linear array: see page 16 

Characteristic function of a set A: 


1 ifxeA 
f=) fx A. 


Countable set: a set that corresponds to a 
sequence 

Word: finite sequence of elements of A 
Regular expression: see page 19 

Theorem: If n # 0 and m are nonnegative inte- 
gers, we can write m = qn + r for some non- 
negative integers q and r with O Ss r < n. 
Moreover, there is just one way to do this, 
GCD< (a, 6): d = GCD(a, b) if d|a, d|b, and d is 
the largest common divisor of a and b. 
Theorem: If d is GCD(a, b), then 

(a) d= sa + th for some integers s and t. 

(b) Ifc|aandc|b, then eld. 

Relatively prime: two integers a and b with 
GCD(a, 6) = 1 

Euclidean algorithm: method used to find 
GCD<(a, 5); see page 25 


Ad 


e¢e¢e¢ 


++ ¢ 


LCM(a, b): ¢ = LCM(a, b) if ale, b|c, and c is 
the smallest common multiple of a and b 
GCD<(a, b) - LCM(a, b) = ab 

mod-n function: f,(z) = r, where z =r (mod n) 
Matrix: a rectangular array of numbers 

Size of a matrix: A is m X nif it has m rows and 
n columns 

Diagonal matrix: a square matrix with zero 
entries off the main diagonal 

Equal matrices: matrices of the same size 
whose corresponding entries are equal 

A + B: the matrix obtained by adding corre- 
sponding entries of A and B 

Zero matrix: a matrix all of whose entries are 
Zero 

AB: see page 32 

I, (identity matrix): a square matrix with 1’s on 
the diagonal and 0’s elsewhere 

Al: the matrix obtained from A by interchang- 
ing the rows and columns of A 

Symmetric matrix: A” = A 

Array of dimension two: see page 32 

Boolean matrix: a matrix whose entries are 
either one or zero 

A V B:see page 35 

A/\ B: see page 35 

A © B:see page 36 

Properties of Boolean matrix operations: see 
page 37 

Mathematical structure: a collection of objects 
with operations defined on them and the 
accompanying properties 

Binary operation: an operation that combines 
two objects 

Unary operation: an operation that requires 
only one object 

Closure property: each application of the oper- 
ation produces another object in the collection 


Associative property: (x O y) O z = 
xO (yOz) 

De Morgan’s laws: (x 0 y)* = x* V y* and 
(x V y)* = x* O y* 


Identity for 0: an element e such that x 0 e = 
e Ox = x for all x in the structure 

O-inverse of x: an element y such that 
xOy=yOx =e, where ¢ is the identity for 0 


CODING EXERCISES 


For each of the following, write the requested pro- 
gram or subroutine in pseudocode (as described in 
Appendix A) or in a programming language that 
you know. Test your code either with a paper-and- 
pencil trace or with a computer run. 


In Exercises 1 through 3, assume that A and 
B are finite sets of integers. Write a subroutine to 
compute the specified set. 
LAUB 
2 ANB 


3A-B 


Coding Exercises 4§ 


. Consider the sequence recursively defined by 


g(0)=1  g(1j)=-1 
g(n) = 3g(n — 1) — 2g(n - 2) 


(a) Write a subroutine that will print the first 
20 terms of the sequence. 

(b) Write a subroutine that will print the first 
n terms of the sequence. The user should 
be able to supply the value of n at runtime. 


§. Write a subroutine to find the least common 


multiple of two positive integers. 


CHAPTE 


Prerequisite: Chapter 1 


Logic is the discipline that deals with the methods of reasoning. On an elemen- 
tary level, logic provides rules and techniques for determining whether a given 
argument is valid. Logical reasoning is used in mathematics to prove theorems, in 
computer science to verify the correctness of programs and to prove theorems, in 
the natural and physical sciences to draw conclusions from experiments, and in 
the social sciences and in our everyday lives to solve a multitude of problems. 
Indeed, we are constantly using logical reasoning. In this chapter we discuss a few 
of the basic ideas. 


2.1. Propositions and Logical Operations 


A statement or proposition is a declarative sentence that is either true or false, 
but not both. 
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Example 1. Which of the following are statements? 
(a) The earth is round. 


(b)2+3=5 
(c) Do you speak English? 
(d)3—x=5 


(e) Take two aspirins. 
(f) The temperature on the surface of the planet Venus is 800° F. 
(g) The sun will come out tomorrow. 


Solution 

(a) and (b) are statements that happen to be true. 

(c) is a question, so it is not a statement. 

(d) is a declarative sentence, but not a statement, since it is true or false 
depending on the value of x. 

(e) is not a statement; it is a command. 

(f) is a declarative sentence whose truth or falsity we do not know at this 
time; however, we can in principle determine if it is true or false, so it is 
a statement. 

(g) is a statement since it is either true or false, but not both, although we 
would have to wait until tomorrow to find out if it is true or false. 


Logical Connectives and Compound Statements 


In mathematics, the letters x, y, z,... often denote variables that can be replaced 
by real numbers, and these variables can be combined with the familiar opera- 
tions +, X, —,and ~. In logic, the letters p, q, r,...denote propositional variables, 
that is, variables that can be replaced by statements. Thus we can write p: The sun 
is shining today. q: It is cold. Statements or propositional variables can be com- 
bined by logical connectives to obtain compound statements. For example, we 
may combine the preceding statements by the connective and to form the com- 
pound statement p and q: The sun is shining and it is cold. The truth value of a 
compound statement depends only on the truth values of the statements being 
combined and on the types of connectives being used. We shall now look at the 
most important connectives. 

If p is a statement, the negation of p is the statement not p, denoted by ~p. 
Thus ~p is the statement “it is not the case that p.” From this definition, it follows 
that if p is true, then ~p is false, and if p is false, then ~p is true. The truth value 
of ~p relative to p is given in Table 2.1. Such a table, giving the truth values of a 
compound statement in terms of its component parts, is called a truth table. 


Table 2.1 
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Strictly speaking, not is not a connective, since it does not join two statements, 
and ~p is not really a compound statement. However, not is a unary operation 
for the collection of statements, and ~p is a statement if p is. 


Example 2. Give the negation of the following statements. 
(a) p:2+3>1 (b) q: It is cold. 


Solution 

(a) ~p: 2 + 3 is not greater than 1. That is, ~p: 2 + 3 = 1. Since p is true 
in this case, ~p is false. 

(b) ~g: It is not the case that it is cold. More simply, ~g: It is not cold. 


If p and q are statements, the conjunction of p and q is the compound state- 
ment “p and q,” denoted by p /\ g. The connective and is denoted by the symbol 
/\.In the language of Section 1.6, and is a binary operation on the set of state- 
ments. The compound statement p /\ q is true when both p and q are true; oth- 
erwise, it is false. The truth values of p /\ g in terms of the truth values of p and 
of ¢ are given in the truth table shown in Table 2.2. Observe that in giving the 
truth table of p  q we need to look at four possible cases. This follows from the 
fact that each of p and q can be true or false. 


Table 2.2 


Example 3. Form the conjunction of p and q for each of the following. 


(a) p: It is snowing. q. 1am cold. 

(b) p: 2<3 q ~5 > -8 

(c) p: It is snowing. Gg. 3<5 
Solution 


(a) pq: It is snowing and I am cold. 
(b) pN\q: 2<3and —-£ > —-8 
(c) pq: Itis snowing and 3 < 5. ° 


Example 3(c) shows that in logic, unlike in everyday English, we may join 
two totally unrelated statements by the connective and. 

If p and q are statements, the disjunction of p and q is the compound state- 
ment “p or g,” denoted by p \/ q. The connective or is denoted by the symbol \. 
The compound statement p \/ g's true if at least one of p or gq is true; it is false 
when both p and gq are false. The truth values of p \/ q are given in the truth table 
shown in Table 2.3. 
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Table 2.3 


Example 4. Form the disjunction of p and q for each of the following. 


(a) p: 2 is a positive integer. g: V2 isa rational number. 
(b) p: 2+345 q: London is the capital of France. 
Solution 


(a) pV q: 2isa positive integer or V2 is a rational number. Since p is true, 
the disjunction p \/ q is true, even though q is false. 

(b) p \/ qg: 2 + 3 #5 or London is the capital of France. Since both p and 
q are false, p \/ q is false. ¢ 


Example 4(b) shows that in logic, unlike in ordinary English, we may join 
two totally unrelated statements by the connective or. 

The connective or is more complicated than the connective and because it 
is used in two different ways in English. Suppose that we say “I drove to work or 
I took the train to work.” In this compound statement we have the disjunction of 
the statements p: “I drove to work” and q: “I took the train to work.” Of course, 
exactly one of the two possibilities occurred. Both could not have occurred, so 
the connective or is being used in an exclusive sense. On the other hand, consider 
the disjunction “I passed mathematics or J failed French.” In this case, at least one 
of the two possibilities occurred. However, both could have occurred, so the 
connective or is being used in an inclusive sense. In mathematics and computer 
science, we agree to use the connective or always in the inclusive manner. 


Quantifiers 


In Section 1.1, we defined sets by specifying a property P(x) that elements of the 
set have in common. Thus an element of {x | P(x)} is an object ¢ for which the 
statement P(r) is true. Such a sentence P(x) is called a predicate, because in 
English the property is grammatically a predicate. P(x) is also called a proposi- 
tional function, because each choice of x produces a proposition P(x) that is 
either true or false. 


Example 5. Let A = {x | x is an integer less than 8}. Here P(x) is the sentence 
“x is an integer less than 8.” The common property is “is an integer less than 8.” 
Since P(1) is true, 1 € A. Sa 


The universal quantification of a predicate P(x) is the statement “For all 
values of x, P(x) is true.” We assume here that only values of x that make sense 
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in P(x) are considered. If we wish to restrict the values of x, we can, for example, 
write Vx = 0 or Vn © Z. The universal quantification of P(x) is denoted Vx P(x). 
The symbol V is called the universal quantifier. 


Example 6 

(a) The sentence P(x): —(—x) = x is a predicate that makes sense for real num- 
bers x. The universal quantification of P(x), Vx P(x), is a true statement, 
because for all real numbers —(—x) = x. 

(b) Let Q(@): x + 1 <4. Then '¥x = 0 Q(x) is a false statement, because Q(5) is 
not true. ¢ 


Universal quantification can also be stated in English as “for every x,” 
“every x,” or “for any x.” 

A predicate may contain several variables. Universal quantification may be 
applied to each of the variables. For example, a commutative property can be 
expressed as Vx Vy x LC. y = y [1 x. The order in which the universal quantifiers 
are considered does not change the truth value. Often mathematical statements 
contain implied universal quantifications, for example, in Theorem 1, Section 1.2. 

In some situations we only require that there be at least one value for which 
the predicate is true. The existential quantification of a predicate P(x) is the state- 
ment “There exists a value of x for which P(x) is true.” The existential quan- 
tification of P(x) is denoted Ax P(x). The symbol J is called the existential 
quantifier. We may include restrictions in the quantifier such as Ax > 0. 


Example 7 

(a) Let Q(x): x + 1 <4. The existential quantification of Q(x), 3x Q(x), is a true 
statement, because Q(2) is a true statement. 

(b) The statement dy y + 2 = y is false. There is no value of y for which the 
propositional function y + 2 = y produces a true statement. 6 


In English 4x can also be read “there is an x,” “there is some x,” “there 
exists an x,” or “there is at least one x.” 

Existential quantification rnay be applied to several variables in a predicate, 
and the order in which the quantifications are considered does not affect the 
truth value. For a predicate with several variables, we may apply both universal 
and existential quantification. In this case the order does matter. 


Example 8. Let A and B bea X n matrices. 
(a) The statement VA 3B (A + B) = I, is read “for every A there is a B such 
that A + B = I.” For a given A = [a,], define B = [b,] as follows, b,, = 


1-—a;, 1S isn and b; = -a,i4j,1 = isn, 1 <j =n. Then 
A + B = I, and we have shown that VA 3B (A + B) = I, is a true 
statement. 


(b) 3B VA (A + B) = I, is the statement “there is a B such that for all A 
A + B = fI,.” This statement is false, no single B has this property 
for all A’s. 

(c) 3B VA (A + B) = A is true. What is the value for B that makes the state- 
ment true? Sd 
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Let p: Vx P(x). The negation of p is false when p is true and true when p is 
false. For p to be false, there must be at least one value of x for which P(x) is false. 
Thus p is false if 3x ~P(x) is true. On the other hand, if x ~P(x) is false, then 
for every x, ~P(x) is false, so P(x) is true; that is, Vx P(x) is true. This shows that 
the negation of p is Sx ~P(x). 


Example 9 

(a) Let p: For all positive integers n, n? + 41n + 41 is a prime number. Then ~p: 
There is at least one positive integer m for which n? + 41n + 41 is not prime. 

(b) Let g: There is some integer k for which 12 = 3k. Then ~q: For all integers 


k, 12 # 3k. ° 


EXERCISE SET 2.1 


1. 


2. 


Which of the following are statements? 

(a) Is 2 a positive number? 

(b) x? +x+1=0 

(c) Study logic. 

(d) There will be snow in January. 

(e) If stock prices fall, then I will lose money. 


Give the negation of each of the following 

statements. 

(a) 2+7¢11 

(b) 2 is an even integer and 8 is an odd integer. 

(c) It will rain tomorrow or it will snow tomor- 
row. 

(d) If you drive, then I will walk. 


. In each of the following, form the conjunction 


and the disjunction of p and q. 
(a) p:3+1<5 

(b) p: 1 am rich. 

(c) p:1 will drive my car. 


qgi7=3X6 
q: 1 am happy. 
q:1 will be late. 


. Determine the truth or falsity of each of the 


following statements. 

(a) 2 <3 and 3 is a positive integer. 

(b) 2 = 3 and 3 is a positive integer. 

(c) 2 <3 and 3 is not a positive integer. 
(d) 2 = 3 and 3 is not a positive integer. 


Determine the truth or falsity of each of the 
following statements. 

(a) 2 <3 or 3 is a positive integer. 

(b) 2 = 3 or 3 is a positive integer. 

(c) 2 <3 or 3 is not a positive integer. 

(d) 2 = 3 or 3 is not a positive integer. 


6. Which of the following statements is the nega- 
tion of the statement “2 is even and —3 is nega- 
tive”? 

(a) 2 is even and —3 is not negative. 
(b) 2 is odd and ~—3 is not negative. 
(c) 2 is even or —3 is not negative. 
(d) 2 is odd or —3 is not negative. 


7. Which of the following statements is the nega- 
tion of the statement “2 is even or —3 is nega- 
tive”? 

(a) 2 is even or —3 is not negative. 
(b) 2 is odd or —3 is not negative. 
(c) 2 is even and —3 is not negative. 
(d) 2 is odd and —3 is not negative. 


In Exercises 8 and 9 use p: Today is Monday; 
q: The grass is wet; and r: The dish ran away 
with the spoon. 


8. Write each of the following in terms of p, q, r, 

and logical connectives. 

(a) Today is Monday and the dish did not run 
away with the spoon. 

(b) Either the grass is wet or today is Monday. 

(c) Today is not Monday and the grass is dry. 

(d) The dish ran away with the spoon, but the 
grass is wet. 


9. Write an English sentence that corresponds to 
each of the following. 
(a) ~rAq (b) ~aVp 
()~~va) Wpvrr 
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In Exercises 10 through 15, use P(x): x is even; 
Q(x): x is a prime number; and R(x, y): x + y is 


15. Determine the truth value of each statement 
given in Exercises 10 through 13. 


even. The variables x and y represent integers. 
16. Make a truth table for each of the following. 

10. Write an English sentence corresponding to (a) (~PAq@) VP (b) PV QV ~4 

each of the following. 

(a) Vx P(x) (b) Ax Q(x) 17. Make a truth table for each of the following. 
(a) (PV q)Ar (b) (~PV a) A~r 

11. Write an English sentence corresponding to 
each of the following. 


(a) Wx dy R(x, y) (b) 3x Vy R(x, y) 


For Exercises 18 through 20, define p | q to be 
a true statement if neither p nor q is true. 


12. Write an English sentence corresponding to 
each of the following. 


(a) Vx (~Q&x)) (b) Ay (~PQ) 


13. Write an English sentence corresponding to 
each of the following. 


(a) ~(Ax P(x))  (b) ~(Wx Q(x)) 18. Make a truth table for (p Lg) Lr. 

14. Write each of the following in terms of P(x), 19. Make a truth table for (p bg) \(p Ur). 
Q(x), R(x, y), logical connectives, and quanti- 
fiers. 20. Make a truth table for (p lq) J (p Vr). 


(a) Every integer is an odd number. 
(b) The sum of any two integers is an even 
number. 


2.2. Conditional Statements 


If p and q are statements, the compound statement if p then g, denoted p > q, is 
called a conditional statement. or implication. The statement p is called the 
antecedent or hypothesis, and the statement q is called the consequent or con- 
clusion. The connective if... then is denoted by the symbol >. 


Example 1. Write the implication p > q for each of the following. 
(a) p: Iam hungry. q: I will eat. 
(b) p: It is snowing. go3+5=8 


Solution 
(a) If I am hungry, then I will eat. 
(b) If it is snowing, then 3 +- 5 = 8. ° 


Example 1(b) shows that in logic we use conditional statements in a more 
general sense than is customary. Thus, in English, when we say “if p then g,” we 
are tacitly assuming that there is a cause-and-effect relationship between p and 
q. That is, we would never use the statement in Example 1(b) in ordinary English, 
since there is no way statement j7 can have any effect on statement g. 
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In logic, implication is used in a much weaker sense. To say that the com- 
pound statement p — q is true simply asserts that if p is true, then q will also be 
found to be true. In other words, p > gq says only that we will not have p true and 
q false at the same time. It does not say that p “caused” q in the usual sense. Table 
2.4 describes the truth values of p — q in terms of the truth values of p and q. 
Notice that p — q is considered false only if p is true and q is false. In particular, 
if p is false, then p — gq is true for any q. This fact is sometimes described by the 
statement, “A false hypothesis implies any conclusion.” This statement is mis- 
leading, since it seems to say that if the hypothesis is false, the conclusion must be 
true, an obviously silly statement. Similarly, if g is true, then p — q will be true for 
any statement p. The implication “If 2 + 2 = 5, then I am the king of England” is 
true, simply because p: 2 + 2 = 5 is false, so it is not the case that p is true and q 
is false simultaneously. 


Table 2.4 


In the English language, and in mathematics, each of the following expres- 
sions is an equivalent form of the conditional statement p — q: p implies q; q, if 
D;p only if q; p is a sufficient condition for g; g is a necessary condition for p. 

If p > q is an implication, then the converse of p — q is the implication 
q — p, and the contrapositive of p — q is the implication ~g > ~p. 


Example 2. Give the converse and the contrapositive of the implication “If it is 
raining, then I get wet.” 


Solution: We have p:It is raining; and q: I get wet. The converse is g > p: 
If I get wet, then it is raining. The contrapositive is ~qg > ~p: If I do not get 
wet, then it is not raining. a 


If p and q are statements, the compound statement p if and only if g, de- 
noted by p < q, is called an equivalence or biconditional. The connective if and 
only if is denoted by the symbol <>. The truth values of p © q are given in Table 
2.5. Observe that p < q is true only when both p and q are true or when both p 
and q are false. The equivalence p <> gq can also be stated as p is a necessary and 
sufficient condition for q. 


Table 2.5 

q| P| 
T T T 
T F F 
F T F 
F F T 
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Example 3. Is the following equivalence a true statement? 3 > 2 if and only if 
0<3-2. 


Solution: Let p be the statement 3 > 2 and let g be the statement 0 < 3 — 2. 
Since both p and q are true, we conclude that p < gq is true. ¢ 


In general, a compound statement may have many component parts, each 
of which is itself a statement, represented by some propositional variable. The 
statement s: p > (q /\ (p > r)) involves three propositions, p, q, and r, each of 
which may independently be true or false. There are altogether 2° or 8 possible 
combinations of truth values for », g, and r, and the truth table for s must give the 
truth or falsity of s in all these cases, If a compound statement s contains n com- 
ponent statements, there will need to be 2” rows in the truth table for s. (In 
Section 3.1, we look at how to ccunt the possibilities in such cases.) Such a truth 
table may be systematically constructed in the following way. 


Step 1. The first columns of the table are labeled by the component proposi- 
tional variables. Additional cclumns are included for all intermediate combi- 
nations of the variables, culminating in a column for the full statement. 


STEp 2. Under each of the first headings, we list the 2” possible -tuples of truth 
values for the n component statements. 


Step 3. For each row, we compe, in sequence, all remaining truth values. 


Example 4. Compute the truth table of the statement (p > q) © (~q > ~p). 
Table 2.6 is constructed using steps 1,2, and 3. The numbers at the bottom of the 
columns shows the order in which they are constructed. 


Table 2.6 


P @ ~q>~P | (P72) e(~q>~p) 
T T T T 
T F F T 
F T T T 
F F T T 
(4) (5) 


A statement that is true for all possible values of its propositional variables 
is called a tautology. A statement that is always false is called a contradiction or 
an absurdity, and a statement that can be either true or false, depending on the 
truth values of its propositional variables, is called a contingency. 


Example 5 

(a) The statement in Example 4s a tautology. 

(b) The statement p /\ ~p is an absurdity. (Verify this.) 

(c) The statement (p > q) /\ (p ‘V q) is a contingency. a 
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We have now defined a new mathematical structure with two binary oper- 
ations and one unary operation [propositions, /\, \/, ~]. It makes no sense to say 
that two propositions are equal; instead we say that p and q are logically equiva- 
lent, or simply equivalent, if p © q is a tautology. When an equivalence is shown 
to be a tautology, this means that its two component parts are always either both 
true or both false for any values of the propositional variables. Thus the two sides 
are simply different ways of making the same statement and can be regarded as 
“equal.” We denote that p is equivalent to g by p = g. Now we can adapt our 
properties for operations to say this structure has a property if using equivalent 
in place of equality gives a true statement. 


Example 6. The binary operation \/ has the commutative property; that is, 
P\/q =4d\ p. The truth table (Table 2.7) for (p V g) © (q V p) shows that the 
statement is a tautology. 


Table 2.7 


P| PVQMeE@VP) 


V 
T 
T 
T 
F 


DIdgH|s 
A maH)s 
Sans 


o 


Another way to use a truth table to determine if two statements are equiv- 
alent is to construct a column for each statement and compare these to see if they 
are identical. In Example 6 the third and fourth columns are identical, and this 
will guarantee the statements that they represent are equivalent. 

Forming p — g from p and q is another binary operation for statements, but 
we can express it in terms of the operations in Section 2.1. 


Example 7. The conditional statement p > q is equivalent to (~p) V 4. 
Columns (1) and (3) in Table 2.8 show that, for any truth values of p and q, 
p—qand (~p) \ q have the same truth values. 


Table 2.8 


(1) 2) 3) 


¢ 


The structure [propositions, /\, V, ~] has many of the same properties as 
[sets, U, M, 7]. 


Theorem 1. The operations for propositions have the following properties. 
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Commutative Properties 
lpVq=4\VP 
2.p\q=4q\p 
Associative Properties 
3. pV AVN=OVaVE 
4. pN(qArn)=(pAg)Ar 
Distributive Properties 
5. pV (GAr= OV QNAPYV 
6 PNGVN=PAgV PAD 
Idempotent Properties 
7. pV p=p 
8. p/\p=p 
Properties of Negation 
9 py =P 
10. ~( V 4) = (~P)/\ (~4) 
11. ~@Ag)=(Cp)V (~@Q) 10 and 11 are De Morgan's laws. 
Proof; We have proved Property 1 in Example 6. The remaining proper- 
ties may be proved the same way and are left for the reader as exercises. 
¢ 
The implication operation also has a number of important properties. 
Theorem 2 


(a) (pg) =(-P)Vg) © 

(b) (p> 4) = ((-9) 9 ~~?) 
C)peg=(P2)DAW>P)) 

(d) ~~ > 49) =@A~4) 

(ce) ~peg=(PA~av qN~p)) 


Proof: Part (a) was proved in Example 7 and part (b) was proved in 
Example 4, Note that part (b) says that a conditional statement is equiva- 
lent to its contrapositive. 

Part (d) gives an alternative version for the negation of a conditional 
statement. This could be proved using truth tables, but it can also be proved 
by using previously proven facts. Since (p > q) = ((~p) V q), the negation 
of p > q must be equivalent to ~((~p) \V q). By De Morgan’s laws, 
~((~P) V 4) = (~(Pp)) A (4) or p A (~q). Thus ~(p > 4) = 
(p “ (~q)). 


The remaining parts of Theorem 2 are left as exercises. od 


Theorem 3 states two results from Section 2.1 and several other properties 


for the universal and existential quantifiers. 


Theorem 3 


(a) ~(Vx P(x)) = ax ~PCe 
(b) ~(Ax ~P(x)) = Vx P(r) 
(c) Sx (P(x) > O(@)) = Vx PY) — ax OO) 
(d) ax P(x) = Wx Q(*) = Vx (PQ) 9 QQ@)) 
(e) ax (P(e) V Q(x) = 3x P(x) V ax Q@) 
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(f) Vx (P(x) A Q(Q)) = Vx PAX) A Vx Q(x) 
(g) (Wx P(x) V (Wx Q(x))) > Vx (P(x) V Q(x) is a tautology. 
(h) Sx (P(x) A Q(X) = ax P(x) A Ax O(2) is a tautology. a 


The following theorem gives several important implications that are tau- 
tologies. These will be used extensively in proving results in mathematics and 
computer science, and we will illustrate them in Section 2.3. 


Theorem 4. Each of the following is a tautology. 
(a) @Aq)>P (b) Ag) 4 
(c) p> eva (d) q> (PV 4) 
(ce) ~p> (p> 4) () ~p>4qg)>P 
(g) PA\(>9)>4 (h) (~PA@V 4) > 4 
i) -qA@rg))>~pP HO @C2DAG?RN Cn Ad 


EXERCISE SET 2.2 


(d) If I have time and J am not too tired, then I 
will go to the store. 

(e) If I have enough money, then I will buy a 
car and I will buy a house. 


In Exercises 1 and 2 use the following: p: I am 
awake; q: I work hard; r: I dream of home. 


1, Write each of the following statements in terms 
of p,q, r, and logical connectives. 


(a) I am awake implies that I work hard. 4. State the contrapositive of each implication in 


(b) I dream of home only if I am awake. Exercise 3. 
(c) Working hard is sufficient for me to be 
awake. 5. Determine the truth value for each of the fol- 


lowing statements. 

(a) If 2 is even, then New York has a large pop- 
ulation. 

(b) If 2 is even, then New York has a small 


(d) Being awake is necessary for me not to 
dream of home. 


2. Write each of the following statements in terms 


of p,q, r, and logical connectives. population. 

(a) I am not awake if and only if I dream of (c) If 2 is odd, then New York has a large pop- 
home. ulation. 

(b) If 1 dream of home, then I am awake and I (4) If2 is odd, then New York has a small pop- 
work hard. ulation. 


(c) I do not work hard only if I am awake and 
I do not dream of home. 

(d) Not being awake and dreaming of home is 
sufficient for me to work hard. 


In Exercises 6 and 7, let p,q, and r be the follow- 
ing statements: p: I will study discrete structures; 
q:l will go to a movie; r: I am in a good mood. 


3. State the converse of each of the following 6. Write the following statements in terms of p, q, 


implications. r,and logical connectives. 
(a) If2 + 2 = 4, then I am not the Queen of (a) If I am not in a good mood, then I will go 
England. to a movie. 


(b) If I am not President of the United States, 
then I wilt walk to work. 

(c) If I am late, then I did not take the train to 
work. 


(b) I will not go to a movie and I will study dis- 
crete structures. 

(c) I will go to a movie only if I will not study 
discrete structures. 
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(d) If I will not study discrete structures, then I 
am not in a good mood. 


. Write English sentences corresponding to the 


following statements. 
(a) ((~p)\q)>r 
(c) (~r) > ((~a) VP) 


(b) r>@Vv4) 
@) @ACp)er 


Construct truth tables to determine whether 
each of the following is a tautology, a contin- 
gency, or an absurdity. 

(a) p/\~p (b) p> (@>P) 
(c) q>(¢>P) (d) aV (~a AP) 
(e) @Ap)V@A~p) ) PAdaP 
(8) p> (ap) 


. If p > q is false, can you determine the truth 


10. 


1. 


12. 


value of (~(p /\ q)) > q? Explain your answer. 


If p > q is true, can you determine the truth 


value of (~p) \/ (p > q)? Explain your answer. 


Use the definition of p | q given for Exercise 
18 in Section 2.1 and show that ((p J p) 4 
(q J q)) is equivalent to p A q. 


Write the negation of each of the following in 

good English. 

(a) The weather is bad and I will not go to 
work. 

(b) If Carol is not sick, then if she goes to the 
picnic, she will have a good time. 

(c) I will not win the game or I will not enter 
the contest. 


2.3. Methods of Proof 


13. 


14, 


15. 


Consider the following conditional statement: 
p: If the flood destroys my house or the fire 
destroys my house, then my insurance company 
will pay me. 

(a) Which of the following is the converse of p? 
(b) Which of the following is the contrapositive 

of p? 

(i) If my insurance company pays me, then 
the flood destroys my house or the fire 
destroys my house. 

(ii) If my insurance company pays me, then 
the flood destroys my house and the 
fire destroys my house. 

(iii) If my insurance company does not pay 
me, then the flood does not destroy 
my house or the fire does not destroy 
my house. 

(iv) If my insurance company does not pay 
me, then the flood does not destroy my 
house and the fire does not destroy 
my house. 


Prove Theorem 1, part 6. 


Prove Theorem 1, part 11. 


. Prove Theorem 2, part (e). 
. Prove Theorem 4, part (a). 


. Prove Theorem 4, part (d). 


Prove Theorem 4, part (g). 


Prove Theorem 4, part (j). 


Some methods of proof that we have already used are direct proofs using 
generic elements, definitions, and previously proven facts and proofs by cases, 
such as examining all possible truth value situations in a truth table. Here we look 


at proofs in more detail. 


If an implication p > g is a tautology, where p and q may be compound 
statements involving any number of propositional variables, we say that q logi- 
cally follows from p. Suppose that an implication of the form 


(MAPA NP, 4 


is a tautology. Then this implication is true regardless of the truth values of 
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any of its components, In this case, we say that g logically follows from p,, p>,...,P,+ 
When q logically follows from p,, p.,...,p,, We Write 


P; 


og 
where the symbol... means therefore. This means that if we know that p, is true, 
Pz is true,..., and p, is true, then we know that q is true. 

Virtually all mathematical theorems are composed of implications of the 

type 

(Pi AN P+ P,) > 4 

The p,’s are called the hypotheses or premises, and q is called the conclusion. To 
“prove the theorem” means to show that the implication is a tautology. Note that 
we are not trying to show that g (the conclusion) is true, but only that q will be 
true if all the p,; are true. For this reason, mathematical proofs often begin with 
the statement “suppose that p,, p,,..., and p, are true” and conclude with the 
statement “therefore, g is true.” The proof does not show that q is true, but sim- 
ply shows that q has to be true if the p; are all true. 

Arguments based on tautologies represent universally correct methods of 
reasoning. Their validity depends only on the form of the statements involved 
and not on the truth values of the variables that they contain. Such arguments are 
called rules of inference. The various steps in a mathematical proof of a theorem 
must follow from the use of various rules of inference, and a mathematical proof 
of a theorem must begin with the hypotheses, proceed through various steps, each 
justified by some rule of inference, and arrive at the conclusion. 


Example 1. According to Theorem 4(j) of Section 2.2, ((p > qg) \(q > 7)) > 
(p > r) is a tautology. Thus the argument 


pq 
q7r 
wpor 


is universally valid and so is a rule of inference. ° 


Example 2. Is the following argument valid? 


If you invest in the stock market, then you will get rich. 
If you get rich, then you will be happy. 
.. If you invest in the stock market, then you will be happy. 


Solution: The argument is of the form given in Example 1; hence the argu- 
ment is valid, although the conclusion may be false. So 
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Example 3. The tautology (p <> g) © ((p > q) A (q > p)) is Theorem 2(c), 
Section 2.2. Thus both of the fo!lowing arguments are valid. 


Pp4@ 
ia ee ee q->Pp 
“(pray \(q>p) “PO |. « 


Some mathematical theorems are equivalences; that is, they are of the form 
p © q. They are usually stated p if and only if g. By Example 3, the proof of such 
a theorem is logically equivalent with proving both p > q and q — p, and this is 
almost always the way in which equivalences are proved. We first assume that p 
is true, and show that g must then be true; next we assume that q is true and show 
that p must then be true. 

A very important rule of inference is 


Pp 
p>4 
wg. 
That is, p is true, and p — gq is true, so q is true. This follows from Theorem 4(g), 
Section 2.2. 


Some rules of inference were given Latin names by classical scholars. 
Theorem 4(g) is referred to as modus ponens or, loosely, the method of asserting. 


Example 4. Is the following argument valid? 


Smoking is healthy. 
If smoking is healthy, then cigarettes are prescribed by physicians. 
.. Cigarettes are prescribed by physicians. 


Solution: The argument is valid since it is of the form modus ponens. 
However, the conclusion is false. Observe that the first premise, p: smoking 
is healthy, is false. The second premise, p — q, is then true and the conjunc- 
tion of the two premises. (p \ (p > q)), is false. Sd 


Example 5. Is the following argument valid? 


If taxes are |cwered, then income rises. 
Income rises. 
.. Taxes are lowered. 


Solution: Let p: taxes are lowered; and q: income rises. Then the argument 
is of the form 


pq 
q 


Dp. 
Assume that p > q and g aze both true. Now p > q may be true with p 
being false. Then the conclusion p is false. Hence the argument is not valid. 
Another approach to answering this question is to verify whether the state- 
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ment ((p > q) / q) logically implies the statement p. A truth table shows 
that this is not the case. (Verify.) ° 


An important proof technique called the indirect method follows from the 
tautology (p > q) © ((~q) > (~p)). This states, as we previously mentioned, 
that an implication is equivalent to its contrapositive. Thus, to prove p > q indi- 
rectly, we assume that q is false (the statement ~q) and show that p is then false 
(the statement ~p). 


Example 6. Let be an integer. Prove that if n? is odd, then n is odd. 


Solution: Let p:n? is odd and q:n is odd. We have to prove that p > gq is 
true. Instead, we prove the contrapositive, ~g > ~p. Thus suppose that n 
is not odd so that n is even. Then 1 = 2k, where k is an integer. We have 
n? = (2k = 4k? = 2(2k’), so n’ is even. We thus show that if n is even, then 
n? is even, which is the contrapositive of the given statement. Hence the 


given statement has been proved. ° 


Another important proof technique is proof by contradiction. This method 
is based on the tautology ((p — q) /\ (~q)) — (~p). Thus the rule of inference 


pq 
i ae 
~pP 
is valid. Informally, this states that, if a statement p implies a false statement q, 
then p must be false. This is often applied to the case where q is an absurdity or 
contradiction, that is, a statement that is always false. An example is given by tak- 
ing q as the contradiction r \ (~r). Thus any statement that implies a contradic- 
tion must be false. In order to use proof by contradiction, suppose we wish to 
show that a statement q logically follows from statements p,, p,,..., p,,. Assume 
that ~q is true (that is, q is false) as an extra hypothesis and that p,,p,...,p, are 
also true. If this enlarged hypothesis p, \ p, /\---/\ p, /\ (~q) implies a contra- 
diction, then at least one of the statements p,, p,,...,P,, ~q must be false. This 
means that if all the p,’s are true, then ~q must be false, so q must be true. Thus 
q follows from p,, P,...,P,. This is proof by contradiction. 


Example 7. Prove that there is no rational number p/q whose square is 2. In 
other words, show that V2 is irrational. 


Solution: This statement is a good candidate for proof by contradiction, 
because we could not check all possible rational numbers to demonstrate 
that none had a square of 2. Assume (p/q)* = 2 for some integers p and q, 
which have no common factors, If the original choice of p/q is not in lowest 
terms, we can replace it with its equivalent lowest-term form. Then p? = 2q’, 
so p? is even. This implies that p is even, since the square of an odd number 
is odd. Thus p = 2n for some integer n. We see that 2q? = p? = (2n)’ = 4n’, 
so q? = 2n’. Thus q’ is even, and so q is even. We now have that both p and 
g are even and therefore have a common factor of 2. This is a contradiction 
to the assumption. Thus the assumption must be false. Sd 
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We have presented several rules of inference and logical equivalences that 
correspond to valid proof techniques. In order to prove a theorem of the (typi- 
cal) form (p, \ p, \---/\p,) -> 4, we begin with the hypotheses p,, p>... DP, 
and show that some result r, logically follows. Then, using p,, Po, ..., Pas 11, We 
show that some other statement r, logically follows. We continue this process, 
producing intermediate statements r,,r,,...,1,, called steps in the proof, until we 
can finally show that the conclusion g logically follows from py, p>,..-, Parl lx 
..., 1, Each logical step must be justified by some valid proof technique based 
on the rules of inference that we have developed, or on some other rules that 
come from tautological implications we have not discussed. At any stage, we can 
replace a statement that needs to be derived by its contrapositive statement or 
any other equivalent form. 

In practice, the construction of proofs is an art and must be learned in part 
from observation and experience. The choice of intermediate steps and methods 
of deriving them is a creative activity, which cannot be precisely described. 


Example 8. Let m and n be integers. Prove that n? = m? if and only if m = n or 
m=-—n, 


Solution: Let us analyze the proof as we present it. Suppose that p is the 
predicate n? = m’, q is the predicate m = n, and ris the predicate m = —n. 
Then we wish to prove the theorem p > (q \/ r). We know from previous 
discussion that we may irstead prove that s: p > (q \V r) andt:(q\VVr) > p 
are true. Thus we assume that either g: m = n or r:m = —n is true. If q is 
true, then m? = n?, and if r is true, then m? = (—n)’ = n’, so in either case p 
is true. We have therefore shown that the implication r: (¢ \V r) > p is true. 

Now we must prove that s: p — (q \/r) is true; that is, we assume p and 
try to prove either g or +. If p is true, then n? = m’, so m? — rn? = 0. 
But m? — n? = (m ~ n)(m + n). If 7, is the intermediate statement 
(m ~ n)(m + n) = 0, we have shown that p > 7, is true. We now show 
that r; > (q \/ r) is true by showing that the contrapositive, ~(g¢ \V r) > 
(~n) is true. Now ~(g \/ r) is equivalent to (~qg) /\ (~r), so we show that 
(~q) A (~r) > (-7,). Thus, if (~¢g): m # n and (~r): m # —n are 
true, then (m — n) #0 and (m + n) # 0,80 (m — n)(m + n) # O and 1, is 
false. We have therefore shown that r,; > (q \/ r) is true. Finally, from the 
truth of p > r, andr, > (7 Vr), we can conclude that p > (q \/ r) is true, and 
we are done. e 


We do not usually analyze proofs in this detailed manner. We have done so 
only to illustrate that proofs are devised by piecing together equivalences and 
valid steps resulting from rules of inference. The amount of detail given in a proof 
depends on who the reader is likely to be. 

As a final remark, we reinind the reader that many mathematical theorems 
actually mean the statement is true for all objects of a certain type. Sometimes 
this is not evident. Thus the theorem in Example 8 really states that, for all inte- 
gers m and n, m? = n? if and only if m = n or m = —n. Similarly, the statement 
“If x and y are real numbers, and x # y, thenx < yor y < x” is a statement about 
all real numbers x and y. To prove such a theorem, we must make sure that the 
steps in the proof are valid for every real number. We could not assume, for 
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example, that x is 2 or that y is 7 or V3. This is why proofs often begin by select- 
ing a generic element, denoted by a variable. On the other hand, we know from 
Section 2.2, that the negation of a statement of the form Vx P(x) is dx ~P(x), so 
we need only find a single example where the statement is false. 


Example 9. Prove or disprove the statement that if x and y are real numbers, 
(7 = y?) <9 (x = y). 


Solution: The statement can be restated in the form Wx Vy R(x, y). Thus, 
to prove this result, we would need to provide steps, each of which would 
be true for all x and y. To disprove the result, we need only find one exam- 
ple for which the implication is false. Since (—3)? = 3*, but —3 # 3, the 
result is false. Our example is called a counterexample, and any other coun- 
terexample would do just as well. Sd 


In summary, if a statement claims that a property holds for all objects of a 
certain type, then, to prove it, we must use steps that are valid for all objects of 
that type and that do not make reference to any particular object. To disprove 
such a statement, we need only show one counterexample, that is, one particular 
object or set of objects for which the claim fails. 


EXERCISE SET 2.3 


In Exercises 1 through 7, state whether the argu- 6. I will become famous or I will be a writer. 
ment given is valid or not. If it is valid, identify I will not be a writer, 


the tautology or tautologies on which it is based. 


1. 


.. [will arrive tired. 


«. I will become famous. 


“. T will become famous. 


If I drive to work, then I will arrive tired. 7. If I try hard and I have talent, then I will 
lam not tired when I arrive at work. become a musician. 
«. Ido not drive to work. If I become a musician, then I will be happy. 


.. If Twill not be happy, then I did not try hard 
If I drive to work, then I will arrive tired. or I do not have talent. 
| arrive at work tired. 


. I drive to work. 8. (a) Prove that the sum of two even numbers is 
even. 
If I drive to work, then I will arrive tired. (b) Prove that the sum of two odd numbers is 
I do not drive to work. even. 


.. I will not arrive tired, 


we 


. (a) Prove that the structure [even integers, +, *] 
is closed with respect to +. 

(b) Prove that the structure [odd integers, +, *] 
is closed with respect to *. 


If I drive to work, then I will arrive tired. 
I drive to work. 


2: , a 
I will become famous or I will not become a 10. Prove that n* is even if and only if ” is even. 


writer. 


I will become a writer. IL. Prove that A = B if and only if A C B and 


BCA. 


64 Chapter2 Logic 


12. Let A and B be subsets of a universal set U. 
Prove that A C B if and only if BC A. 


13. Show that 
(a) A C Bisa necessary and sufficient condi- 
tion for A U B= B. 
(b) A C Bis a necessary and sufficient condi- 
tionforANB=A., 


14. Prove or disprove: n’ + 41n + 41 is a prime 
number for every integer n. 


15. Prove or disprove: the sum of any five consecu- 
tive integers is divisible by 5, 


2.4. Mathematical Induction 


16. 


17. 


18. 


20. 


Prove or disprove: that 3 | (n° - n) for every 
positive integer n. 


Prove or disprove: Vx x7 > x’, 


Prove that the sum of two prime numbers, each 
larger than 2, is not a prime number. 


Prove that if two lines are each perpendicular 
to a third line in the plane, then the two lines 
are parallel. 


Prove that if x is a rational number and y is an 
irrational number, then x + y is an irrational 
number. 


Here we discuss another proo: technique. Suppose that the statement to be 
proved can be put in the form Wn = n, P(n), where ny is some fixed integer. That 
is, suppose that we wish to show that P(n) is true for all n = n,. The following 
result shows how this can be done. Suppose that (a) P() is true and (b) if P(A) 
is true for some k = no, then P(k + 1) must also be true. Then P(v) is true for all 
n = ny. This result is called the principle of mathematical induction. Thus, to 
prove the truth of a statement Vn = ny P(7) using the principle of mathematical 
induction, we must begin by proving directly that the first proposition P(”,) is 
true. This is called the basis step of the induction and is generally very easy. 
Then we must prove that F(A) — P(A + 1) is a tautology for any choice of 
k = ng. Since the only case where zn implication is false is if the antecedent is true 
and the consequent is false, this step is usually done by showing that, if P(k) were 
true, then P(A + 1) would also jaave to be true. Note that this not the same as 
assuming that P(A) is true for some value of k. This step is called the induction 
step, and some work will usually be required to show that the implication is 


always true. 


Example 1. 
_ n(n +1) 


+ 
m 2 


Solution: Let P(n) be the predicate 1 +2+3+---+n 
this example, n, = 1. 


Show by mathematical induction that, for alln = 1,1 +2+3+ 


_ ws 1) In 


Basis STEP. We must first show that P(1) is true. P(1) is the statement 


eee 


, which is clearly true. 
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INDUCTION STEP. We must now show that for & = 1, if P(k) is true, then P(k + 1) 
must also be true. We assume that for some fixed k = 1, 


+ 
L4243¢st ea MD (1) 
We now wish to show the truth of P(k + 1): 
(k + 1I)((k + 1) + 1) 
5) : 


The left-hand side of P(k +1) can be written as1+2+3+---+k + 
(kK + 1), and we have 


14+24+34::°+(kK+1) 


(14+24+34+:+kh+(kK+)) ~ MED see) Using (1) to replace 


14+2+4+--+k 
k : 
= (k + 1) 5 +1 Factoring 
_ (K+ DK + 2) 
2 
+ +1)+ 
= GEE D) yy The right-hand 


2 side of P(k + 1) 


Thus we have shown that the left-hand side of P(A + 1) equals the right-hand side 
of P(k + 1). By the principle of mathematical induction, it follows that P(7) is 
true for all n = 1. ¢ 


Example 2. Let A,, Aj, A3,...,A, be any n sets. We show by mathematical 
induction that 


ae 


(This is an extended version of one of De Morgan’s laws.) Let P() be the pred- 
icate that the equality holds for any n sets. We prove by mathematical induction 
that, for all n = 1, P(7) is true. 


Basis Step. P(1) is the statement A, = A,, which is obviously true. 
INDUCTION STEP. If P(x) is true for any & sets, then the left-hand side of 
k+1 (5, Se, an yds 2 fe ees 
P(k + nis(U a) =A,UA,U---U A, U Aga 
i=1 
= (A, UA, UU A, )UA,,, Associative property 
of U 
=(A,UA,U+*’UA,) 9 A,z,, By De Morgan’s law 
for two sets 
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A.) (\Aea Using P(k) 


Thus the implication P(k) > P(& + 1) is a tautology, and by the principle of math- 
ematical induction, P(7) is true for all n = 1. 0 


Example 3. We show by matiiematical induction that any finite, nonempty set 
is countable; that is, it can be arranged in a list. 

Let P(n) be the predicate that if A is any set with |A] = 1 = 1, then A is 
countable. (See Chapter 1 for definitions.) 


Basis Srep. Here n, is 1,s0 we let A be any set with one element, say A = {x}. In 
this case x forms a sequence all by itself whose set is A, so P(1) is true. 


INDUCTION STEP. We want to use the statement that if A is any set with k ele- 
ments, then A is countable. Now choose any set B with k + 1 elements and 
pick any element x in B. Since B — {x} is a set with & elements, the induction 
hypothesis P(k) tells us that there is a sequence x,,%),...,x, with B — {x} as 
its corresponding set. The sequence x,,.x,,...,x,,x then has B as the corre- 
sponding set,so B is countable. Since B can be any set with k + 1 elements, 
P(k + 1) is true if P(k) is. Thus, by the principle of mathematical induction, 
P(x) is true for all w = 1. a 


In proving results by induction, you should not start by assuming that 
P(k + 1) is true and attempting 1¢ manipulate this result until you arrive at a true 
statement. This common mistake is always an incorrect use of the principle of 
mathematical induction. 

A natural connection exists between recursion and induction, because 
objects that are recursively defined often use a natural sequence in their defini- 
tion. Induction is frequently the best, maybe the only, way to prove results about 
recursively defined objects. 


Example 4. Consider the following definition of the factorial function: 1! = 1, 
n! = n(n — 1)!, n > 1. Suppose that we wish to prove for all x = 1, n! = 2""1. We 
proceed by mathematical induction, Let P(m):n! = 2""|. Here ny is 1. 


Basis STEP. P(1) is the statement 1! = 2°. Since 1! is 1, this statement is true. 


INDUCTION STEP. We want to show that P(A) > P(k + 1) is a tautology. It will be 
a tautology if P(x) true guarantees P(k + 1) is true. Suppose that k! = 24! for 
some k = 1. Then, by the recursive definition, the left side of P(A + 1) is 

(A+ 1)! =(k + Dk! 
=(k+1)2" Using P(k) 
=2x 2k! k+122,sincek =1 
= 28 Right-hand side of P(& + 1) 
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Thus P(k + 1) is true. By the principle of mathematical induction, it follows 
that P(n) is true for all 7 = 1. ¢ 


The following example shows one way in which induction can be useful in 
computer programming. The pseudocode used in this and the following examples 


is described in Appendix A. 


Example 5. Consider the following function given in pseudocode. 


FUNCTION SQ(A) 

1 Ced0 

2. Ded 

3. WHILE (D #A) 
a. CeCta 
b De D+1 


4, RETURN (C) 
END OF FUNCTION SQ 


The name of the function, SQ, suggests that it computes the square of A. Step 3b 
shows that A must be a positive integer if the looping is to end. A few trials with 
particular values of A will provide evidence that the function does carry out this 
task. However, suppose that we now want to prove that SQ always computes the 
square of the positive integer A, no matter how large A might be. We shall give a 
proof by mathematical induction. For each integer n = 0, let C, and D,, be the val- 
ues of the variables C and D, respectively, after passing through the WHILE loop 
n times, In particular, Cy and Dy represent the values of the variables before loop- 
ing starts. Let P(n) be the predicate C, = A X D,,. We shall prove by induction 
that Vn = 0 P(x) is true. Here ng is 0. 


Basis STEP. P(0) is the statement C, = A X D,, which is true since the value of 
both C and D is zero “after” zero passes through the WHILE loop. 


INDUCTION STEP. We must now use 
P(k): C, = A X D, (2) 


to show that P(A + 1):C,,, = A X D,,,.After a pass through the loop, C is 
increased by A, and D is increased by 1,so C,,; = C, + Aand D,,, = D,+1. 


left-hand side of P(k +1): C,,,=C,+A 
=AXD,+A_— Using (2) to replace C, 
=AX(D,+ 1) Factoring 
=AX Dyiy Right-hand side of 
P(A + 1) 


By the principle of mathematical induction, it follows that as long as 
looping occurs C,, = A X D,,. The loop must terminate. (Why?) When the loop 
terminates, D = A,so C = A X A, or A’, and this is the value returned by the 
function SQ. Sd 
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Example 5 illustrates the use of a loop invariant, a relationship between 
variables that persists through all iterations of the loop. This technique for prov- 
ing that loops and programs do what it is claimed that they do is an important 
part of the theory of algorithm verification. In Example 5 it is clear that the loop- 
ing stops if A is a positive integer, but for more complex cases this may also be 
proved by induction. 


Example 6. Use the technique of Example 5 to prove that the pseudocode 
program given in Section 1.4 does compute the greatest common divisor of two 
positive integers. 


Solution: Here is the pseudocode given earlier. 


FUNCTION GCD(X, Y) 
1. WHILE (XY) 
a. IF(X > ¥) THEN 


1. XeX-Y 
b. ELSE 
1. Ye Y--X 


2. RETURN (X) 
END OF FUNCTION GCD 


We claim that if X and Y are pesitive integers, then GCD returns GCD(X, Y). 
To prove this, let X, and Y,, be the values of X and Y after n = 0 passes through 
the WHILE loop. We claim that P(n): GCD(X,, Y,,) = GCDCX, Y) is true for all 
n = 0, and we prove this by mathematical induction. Here nz is 0. 


BASIS STEP. X, = X, Yj = Y, since these are the values of the variables before 
looping begins; thus P(0) is the statement GCD(X), Yo) = GCD(X, Y), which 
is true. 


INDUCTION STEP. Now let us consider the left-hand side of P(A + 1), that is, 
GCD(X,,.1, ¥;4,). After the k + 1 pass through the loop, either X,,, = X;, 
and Y,,, = Y, — X, or X,,, = X, — Y, and Y,,, = Y,. Then, if P(x): 
GCD(X,, Y,,) = GCD(X, Y) is true, we have by Theorem 5, Section 1.4, that 
GCD(X,445 Yeas) = GCD(X,,, Y,) = GCDC(X, Y). Thus, by the principle of 
mathematical induction, P(7) is true for all n = 0. The exit condition for the 
loop is X,, = Y,, and we have GCD(X,,, Y,) = X,,. Hence the function always 
returns the value GCD(X, Y). e 


EXERCISE SET 2.4 


In Exercises 1 through 12, prove that the state- 2.7 +37 +59 +--+ Qn-1P = 
ment is true by using mathematical induction. n(2n + 1)(2n — 1) 
3 


124+4+64+--+2=n(n + 1) B14 242 4.0542 = 214 


+ 
4 SHI EAS Ho0+ + Sn = ED )) 
5, eg Pree ge pee MUt VEn + 1) 
6 
6. PEPE Pang peter” 
4 


714549409: + (dn — 3) =n(2n - 1) 


no 
Bide eee geet =| 
a-1 
9. a tartar tert grt ta 2), 
coe a 
forr #1 
10. 14+ 2? < 3", forn =2 
1. an <2", forn > 1 
+ 2 
214243+—tn— Cet 


8 


13. Prove by mathematical induction that if a set A 
has n elements, then P(A) has 2” elements. 


14. Prove by mathematical induction that 3 | (n? — 7) 
for every positive integer n. 


15. Prove by mathematical induction that if A,, 
A,,...,A, are any n sets, then 


16. Prove by mathematical induction that if A, 
A,,...,A, and B are any n + 1 sets, then 


(U A] NB= U (A, 0 B). 


17. Prove by mathematical induction that if A,, 
A,,...,A, and B are any n sets, then 


(Aa) UB= nea, UB). 
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18. Let P(m) be the statement 2 | (2 — 1). 
(a) Prove that P(k) — P(k + 1) is a tautology. 
(b) Show that P(x) is not true for any integer n. 
(c) Do the results in parts (a) and (b) contra- 
dict the principle of mathematical induc- 
tion? Explain. 


In Exercises 19 through 23, prove the given 
statement about matrices. 


19. (A, + A, +-+++ A,)7 = AT + AD + +) + AT 
20. (A,A, +++ A,)7 = ATAT_,-+- ATAT 

21. A?A” = A?t” 

22. (A?)" = A” 


23. Let A and B be square matrices If AB = BA, 
then (AB)" = A”B", for n= 1. 


24. Use induction to show that if p is a prime and 
p|a" for n = 1, then p | a. 


25. Prove that if GCD(a, 5) = 1, then GCD(@”, b”) = 
1 for all n = 1. (Hint: Use Exercise 24.) 


26. (a) Find the smallest positive integer n, such 
that 2" > n2. 
(b) Prove 2" > n? for all n = ny. 


In Exercises 27 through 30, show that the given 
algorithm, correctly used, produces the output 
stated by using mathematical induction to 
prove that the relationship indicated is a loop 
invariant and by checking values when the 
looping stops. All variables represent nonnega- 
tive integers. 


27. SUBROUTINE COMP(X, Y; Z) 


1 ZeX 
2 We Y 
3. WHILE (W > 0) 
a ZeZt+yY 
b We W-1 
4. RETURN 
END OF SUBROUTINE COMP 


COMPUTES: Z = X + Y? 
LOOP INVARIANT: (Y x W) + Z=X + ¥? 
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28. SUBROUTINE DIFF (X, Y; Z) 


1 ZX 
2 Wey 
3. WHILE (W > 0) 
a Z<-Z-1 
b Wew-1 
4. RETURN 
END OF SUBROUTINE DIFF 


COMPUTES: Z = X — Y 
LOOP INVARIANT: X - Z+W=Y 


29. SUBROUTINE EXP2(N, M; R) 


1 Rel 
2. Ke 2M 
3. WHILE (K > 0) 
a. R—RXN 
b Ke K-1 
4. RETURN 
END OF SUBROUTINE EXP2 


COMPUTES: R = N2 
LOOP INVARIANT: R x N¥ = N2M 


KEY IDEAS FOR REVIEW 


+ 


+ 


+ 


*e¢ 


Statement: declarative sentence that is either 
true or false, but not both 

Propositional variable: letter denoting a state- 
ment 

Compound statement: statement obtained by 
combining two or more statements by a logical 
connective 

Logical connectives: not (~), and (A), or (\/), if 
then (—), if and only if () 

Conjunction: p / g (p and q) 

Disjunction: p \/ q (p or q) 

Predicate (propositional function): a sentence 
of the form P(x) 

Universal quantification: Vx P(x) [For all val- 
ues of x, P(x) is true.] 

Existential quantification: 3x P(x) [There exists 
an x such that P(x) is true.] 

Conditional statement or implication: p > gq (if 
p then q);p is the antecedent or hypothesis and 
q is the consequent or conclusion 

Converse of p> q: q7p 


30. SUBROUTINE POWER(X, Y; Z) 
1. Z<e0 


2 Wey 

3. WHILE (W > 0) 
a Z—-Z+X 
b We W-1 

4. We Y-1 

5. UEZ 

6. WHILE (W > 0) 
a Ze—Z+U 
b We W-1 

4. RETURN 


END OF SUBROUTINE POWER 
COMPUTES: Z = X x Y? 

LOOP INVARIANT (first loop): 
Zt+(XKXW)=XXY 

LOOP INVARIANT (second loop): 
Z+(Xx YxWw=X+Y¥? 


(Hint: Use the value of Z at the end of the first 
loop and use that in loop 2.) 


Contrapositive of p > g: ~g > ~p 
Equivalence: p © q 
Tautology: a statement that is true for all possi- 
ble values of its propositional variables 
Absurdity: a statement that is false for all pos- 
sible values of its propositional variables 
Contingency: a statement that may be true or 
false, depending on the truth values of its 
propositional variables 
Logically equivalent statements p and q: p = q 
Methods of proof: 

q logically follows from p: see page 58 

Rules of inference: see page 59 

Modus ponens: see page 60 

Indirect method: see page 61 

Proof by contradiction: see page 61 
Counterexample: single instance that disproves 
a theorem or proposition 
Principle of mathematical induction: Let ny be 
a fixed integer. Suppose that for each integer 
n = ny we have a proposition P(n). Suppose 
that (a) P(m)) is true and (b) if P(x) then 


P(k + 1) is a tautology for every k = ny. Then 
the principle of mathematical induction 
states that P() is true for all n = no. 


CODING EXERCISES 


For each of the following, write the requested pro- 
gram or subroutine in pseudocode (as described in 
Appendix A) or in a programming language that 
you know. Test your code either with a paper-and- 
pencil trace or with a computer run. 


1. Write a program that will print a truth table for 
p\~q. 


2. Write a program that will print a truth table for 
(PVQ7>r 


3. 


5. 
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@ Loop invariant: a statement that is true 
before and after every pass through a pro- 
gramming loop 


Write a program that will print a truth table for 
any two-variable propositional function. 


. Write a subroutine EQUIVALENT that deter- 


mines if two logical expressions are equivalent. 


Write a subroutine that determines if a logical 
expression is a tautology, a contingency, or an 
absurdity. 


CHAPTE 


Prerequisite: Chapter 1 


Techniques for counting are important in mathematics and in computer science, 
especially in the analysis of algorithms. In Section 1.2, the addition principle was 
introduced. In this chapter, we present other counting techniques, in particular 
those for permutations and combinations, and look at two applications of count- 
ing, the pigeonhole principle and probability. In addition, recurrence relations, 
another tool for the analysis of computer programs, are discussed. 


3.1. Permutations 


We begin with a simple but genezal result that we will use frequently in this sec- 
tion and elsewhere. 


Theorem 1. Suppose that two tasks T, and T, are to be performed in sequence. If 
T, can be performed in n, ways, and for each of these ways T, can be performed in 
n, ways, then the sequence T,T, can be performed in n,n ways. 
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Proof: Each choice of a method of performing 7, will result in a different 
way of performing the task sequence. There are m, such methods, and for 
each of these we may choose n, ways of performing T,. Thus, in all, there 
will be n\n, ways of performing the sequence 7,T,. See Figure 3.1 for the 
case where n, is 3 and n, is 4. « 


dun oer 


Possible ways of performing task 1 Possible ways of performing task 2 


Possible ways of performing task 1, then task 2 in sequence 
Figure 3.1 


Theorem 1 is sometimes called the multiplication principle of counting. 
(You should compare it carefully with the addition principle of counting from 
Section 1.2.) It is an easy matter to extend the multiplication principle as follows. 


Theorem 2. Suppose that tasks T,, T>,..., T,, are to be performed in sequence. If 
T, can be performed in n, ways, and for each of these ways T, can be performed in 
n, ways, and for each of these n\n, ways of performing T,T, in sequence, T; can be 
performed in n, ways, and so on, then the sequence T,T, --- T, can be performed 
in exactly nn, +--+ ny ways. 


Proof: This result can be proved by using the principle of mathematical 
induction on k. Sd 


Example 1. A label identifier for a computer program consists of one letter fol- 
lowed by three digits. If repetitions are allowed, how many distinct label identi- 
fiers are possible? 


Solution: There are 26 possibilities for the beginning letter and there are 
10 possibilities for each of the three digits. Thus, by the extended multipli- 
cation principle, there are 26 X 10 X 10 X 10 or 26,000 possible label iden- 
tifiers. Sa 


Example 2. Let A be a set with n elements. How many subsets does A have? 
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Solution: We know from Section 1.3 that each subset of A is determined 
by its characteristic function, and if A has n elements, this function may be 
described as an array of 0’s and 1’s having length n. The first element of the 
array can be filled in two ways (with a 0 or a 1), and this is true for all suc- 
ceeding elements as well. Thus, by the extended multiplication principle, 


there are 
2-2...2-2 
es — el 
n factors 
ways of filling the array, and therefore 2” subsets of A. 0d 


We now turn our attention to the following counting problem. Let A be any 
set with n elements and suppose that 1 =r =n. 


Problem 1. How many different sequences, each of length r, can be formed 
using elements from A if 

(a) elements in the sequence may be repeated? 

(b) all elements in the sequerice must be distinct? 
First, we note that any sequence of length r can be formed by filling in r boxes in 
order from left to right with elements of A. In case (a) we may use copies of ele- 
ments of A. 


(a eee eee ee ee 


Box 1 Box 2 Box 3 Boxr-—1 Boxr 


Let T, be the task “fill box 1,” let 7, be the task “fill box 2,” and so on. Then 
the combined task T,T, --- 7, represents the formation of the sequence. 

Case (a). T, can be accomp.ished in n ways, since we may copy any element 
of A for the first position of the sequence. The same is true for each of the tasks 
T>, T;,..., T,. Then, by the ex:ended multiplication principle, the number of 
sequences that can be formed is 


r factors 
We have therefore proved the following result. 


Theorem 3. Let A be a set with n elements and 1 = r Sn. Then the number of 
sequences of length r that can be formed from elements of A, allowing repetitions, 
isn’. 5 


Example 3. How many three-letter “words” can be formed from letters in the 
set a, b, y, z} if repeated letters are allowed? 


Solution: Were n is 4 and r is 3, so the number of such words is 4° or 64, 
by Theorem 3. 0 


Now we consider case (b) cf Problem 1. Here, also, T, can be performed in 
n ways, since any element of A can be chosen for the first position. Whichever ele- 
ment is chosen, only (7 — 1) elements remain, so T, can be performed in (n — 1) 
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ways, and so on, until finally J, can be performed in (n — (r — 1)) or (n — r+ 1) 
ways. Thus, by the extended principle of multiplication, a sequence of r distinct 
elements from A can be formed in n(n — 1) (n — 2)+--(n — r + 1) ways. 

A sequence of r distinct elements of A is often called a permutation of A 
taken r at a time. This terminology is standard and therefore we adopt it, but it is 
confusing. A better terminology might be a “permutation of r elements chosen 
from A.” Many sequences of interest are permutations of some set of n objects 
taken r at a time. The preceding discussion shows that the number of such 
sequences depends only on n and r,not on A. This number is often written ,,P, and 
is called the number of permutations of n objects taken r at a time. We have just 
proved the following result. 


Theorem 4. /f1 =r =n, then ,,P., the number of permutations of n objects taken 
ratatime,isn-(n—1)+(n—2)+---*(n-r 4+). o 


Example 4. Let A be {1, 2, 3, 4}. Then the sequences 124, 421, 341, and 243 are 
some permutations of A taken 3 at a time. The sequences 12, 43, 31,24, and 21 are 
examples of different permutations of A taken two at a time. By Theorem 4, the 
total number of permutations of A taken three at a time is ,P, or 4-3 +2 or 24. 
The total number of permutations of A taken two at a time is ,P, or 4 - 3 
or 12. + 


When r = n, we are counting the distinct arrangements of the elements of 
A, with |A| =n, into sequences of length n. Such a sequence is simply called a per- 
mutation of A. (In Chapter 5 we use the term permutation in a slightly different 
way to increase its utility.) The number of permutations of A is thus ,P,, or 
ne(n—1)*(H—2)e0ee 2°1,ifn = 1. This number is also written 1! and is read 
n factorial. Both ,,P. and n! are built-in functions on many calculators. 


Example 5. Let A be {a, 5, c}. Then the possible permutations of A are the 
sequences abc, acb, bac, bca, cab, and cba. ca 


If we agree to define 0! to be 1, then for every n = 0 we see that the num- 
ber of permutations of # objects is n!. If n = 0 and 1 <r <n, we can now give a 
more compact form for ,P, as follows. 


wPe=n-(n—1)-(n-2)---(v—rt+ 1) 
ne(wn—1Dee HM —rt)-@—r):@—r—):::2-1 
(n—r)-(n—r-1)---2+1 


n! 
(n- nt 


Example 6. Let A consist of all 52 cards in an ordinary deck of playing cards. 
Suppose that this deck is shuffled and a hand of five cards is dealt. A list of cards 
in this hand, in the order in which they were dealt, is a permutation of A taken 
five at a time. Examples would include AH, 3D, SC, 2H, JS; 2H, 3H, 5H, QH, KD; 
JH, JD, JS, 4H, 4C; and 3D, 2H, AH, JS, 5C. Note that the first and last hands 
are the same, but they represent different permutations, since they were dealt in 
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a different order. The number of permutations of A taken five at a time is 
Ps = a or 52 - 51+ 50 - 49+ 48 or 311,875,200. This is the number of five-card 
hands that can be dealt if we consider the order in which they were dealt. ¢ 


Example 7. If A is the set in Example 5, then n is 3, and the number of permu- 
tations of A is 3! or 6. Thus, all the permutations of A are listed in Example 5, as 
claimed. ca 


Example 8. How many “words” of three distinct letters can be formed from the 
letters of the word MAST? 


4! 4! 
(4-3)! or t or 24. Sa 

In Example 8, if the word had been MASS, ,P, would count as distinct some 
permutations that cannot be distinguished. For example, if we tag the two S’s as 
S, and S,, then S,AS, and S,AS, are 2 of the 24 permutations counted; but with- 
out the tags, these are the same: “word.” We have one more case to consider, per- 
mutations with limited repeats. 


Solution: The number is ,P; = 


Example 9. How many distinguishable permutations of the letters in the word 
BANANA are there? 


Solution: We begin by tagging the A’s and N’s in order to distinguish 
among them temporarily. For the letters B, A,, N,, A), N>, A,, there are 6! 
or 120 permutations. Some of these permutations are identical except for 
the order in which the N’s appear, for example, A,A,A,BN,N, and 
A,A,A,BN;N,. In fact, the 120 permutations can be listed in pairs whose 
members differ only in the order of the two N’s. This means that if the tags 
are dropped from the N’s, only m or 60 distinguishable permutations 
remain. Reasoning in a similar way, we see that these can be grouped in 
groups of 3! or 6 that differ only in the order of the three A’s. For example, 
one group of 6 consists of BNNA,A,A;, BNNA,A,A,, BNNA,A,A;, 
BNNA,A,A,, BNNA,A,4,, and BNNA,A,A,. Dropping the tags would 
change these 6 into the single permutation BNNAAA. Thus, there are o or 
10 distinguishable permutations of the letters of BANANA. a 


The following theorem describes the general situation for permutations 
with limited repeats. 


Theorem 5. The number of distinguishable permutations that can be formed 
from a collection of n objects in which the first object appears k, times, the second 
object k, times, and so on, is 


n! 


kylkh . 


Example 10. The number of clistinguishable “words” that can be formed from 
the letters of MISSISSIPPI is TT IEIER or 34,650. Sd 


EXERCISE SET 3.1 


1, A bank password consists of two letters of the 


5. 


9. 


10. 


English alphabet followed by two digits. How 
many different passwords are there? 


In a psychological experiment, a person must 
arrange a square, a cube, a circle, a triangle, and 
a pentagon in a row. How many different 
arrangements are possible? 


. A coin is tossed four times and the result of 


each toss is recorded. How many different 
sequences of heads and tails are possible? 


, A catered menu is to include a soup, a main 


course, a dessert, and a beverage. Suppose that 
a customer can select from four soups, five 
main courses, three desserts, and two beverages. 
How many different menus can be selected? 


A fair six-sided die is tossed four times and the 
numbers shown are recorded in a sequence. 
How many different sequences are there? 


. Compute each of the following. 


(c) 7B 
(f) nani 


(a) 4F, 
(d) F-1 


(b) 6P 
(©) atn-2 


. How many permutations are there of each of 


the following sets? 
(a) {r,s,t, u} 

(b) {1, 2, 3, 4, 5} 
(c) {a, b, 1,2, 3,c¢} 


. For each set A, find the number of permuta- 


. 


tions of A taken r at a time. 

(a) A = {1,2,3,4,5,6,7}, 7 =3 

(b) A = {a, b,c, d,e, f}, r= 2 

(c) A = {x| xis an integer and x° < 16}, r = 4 


In how many ways can six men and six women 

be seated in a row if 

(a) any person may sit next to any other? 

(b) men and women must occupy alternate 
seats? 


Find the number of different permutations of 
the letters in the word GROUP. 


1L 


13. 


16. 


17. 


18. 


19, 


? 


20. 
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How many different arrangements of the letters 
in the word BOUGHT can be formed if the 
vowels must be kept next to each other? 


. (a) Find the number of distinguishable permu- 


tations of the letters in BOOLEAN. 
(b) Find the number of distinguishable permu- 
tations of the Jetters in PASCAL. 


(a) Find the number of distinguishable permu- 
tations of the letters in ASSOCIATIVE. 

(b) Find the number of distinguishable permu- 
tations of the letters in REQUIREMENTS. 


. In how many ways can seven people be seated 


in a circle? 


. A bookshelf is to be used to display six new 


books. Suppose that there are eight computer 
science books and five French books from 
which to choose. If we decide to show four 
computer science books and two French books 
and we are required to keep the books in each 
subject together, how many different displays 
are possible? 


Three fair six-sided dice are tossed and the num- 
bers showing on the top faces are recorded as a 
triple. How many different reports are possible? 
Prove that n+ ,_-;P,_; = ,Py 

Most versions of Pascal allow variable names to 
consist of eight letters or digits with the 
requirement that the first character must be a 
letter. How many eight-character variable 
names are possible? 


Currently, telephone area codes are three-digit 
numbers whose middle digit must be 0 or 1. 
Codes whose last two digits are 1’s are being 
used for other purposes, for example, 911. With 
these conditions, how many area codes are 
available? 


How many Social Security numbers can be 
assigned at any one time? Identify any assump- 
tions you have made. 
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3.2. Combinations 


The multiplication principle and the counting methods for permutations all apply 
to situations where order matters. In this section we look at some counting prob- 
lems where order does not matter. 


Problem 2. Let A be any set with n elements and 1 = r <n. How many differ- 
ent subsets of A are there, each with r elements? 

The traditional name for an r-element subset of an n-element set A is a 
combination of A, taken 7 at a time. 


Example 1. Let A = {1,2,3, 4]. The following are all distinct combinations of A, 
taken three at a time: A, = {1, 2, 3}, A, = {1, 2, 4}, A, = {1, 3, 4}, and A, = 
{2, 3, 4}. Note that these are subsets, not sequences. Therefore, A, = {2, 1, 3} = 
{2, 3, 1} = {1, 3, 2} = {3, 1, 2} = {3, 2, 1}. In other words, when it comes to combi- 
nations, unlike permutations, the order of the elements is irrelevant. od 


Example 2. Let A be the set of all 52 cards in an ordinary deck of playing cards. 
Then a combination of A, taken five at at time, is just a hand of five cards regard- 
less of how these cards were dealt. Sd 


We now want to count the number of r-element subsets of an n-element set 
A. This is most easily accomplished by using what we already know about per- 
mutations. Observe that each permutation of the elements of A, taken r at a time, 
can be produced by performing the following two tasks in sequence. 


Task 1. Choose a subset # of A containing r elements. 
Task 2. Choose a particular permutation of B. 


We are trying to compute the number of ways to choose B. Call this num- 
ber C. Then task 1 can be performed in C ways, and task 2 can be performed in 
r! ways. Thus the total number of ways of performing both tasks is, by the multi- 
plication principle, C - r!. But it is also ,P.. Hence 


C+rl=,P i 
Terl= rear 


Therefore, 


n! 
(aE 
We have proved the following result. 
Theorem 1. Let A be a set with |A| = n,and let 1 <r =n. Then the number 


of combinations of the elements of A, taken r at a time, that is, the number of 
r-element subsets of A, is 


n! 
ri(a— nyt SG 
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Note again that the number of combinations of A, taken r at a time, does 
not depend on A, but only on v and r. This number is often written ,C, and is 
called the number of combinations of 7 objects taken r at a time. We have 


Cc n\ 


mr arta Ay 


This computation can be done directly on many calculators. 


Example 3. Compute the number of distinct five-card hands that can be dealt 
from a deck of 52 cards. 
Solution: This number is sCs = 45 or 2,598,960, because the order in 
which the cards were dealt is irrelevant. Compare this number with the 
number computed in Section 3.1, Example 6. « 


In the discussion of permutations, we considered cases where repetitions 
are allowed. We now look at one such case for combinations. 

Consider the following situation. A radio station offers a prize of three CDs 
from the Top Ten list. The choice of CDs is left to the winner and repeats are 
allowed. The order in which the choices are made is irrelevant. To determine the 
number of ways in which prize winners can make their choices, we use a problem- 
solving technique we have used before; we model the situation with one we 
already know how to handle. 

Suppose that choices are recorded by the station’s voice mail system. After 
properly identifying herself, a winner is asked about each top 10 selection in 
order. At each step, she is asked to press 1 if she wants that CD and 2 to move on 
to the next selection. The 1 can be pressed a second or third time to order a sec- 
ond or third copy of a selection before pressing 2 to move on. When a total of 
three 1’s has been recorded, the process stops and the system tells the caller that 
the selected CDs will be shipped. A record must be created for each of these calls. 
A record will be a sequence of 1’s and 2’s. Clearly, there will be three 1’s in the 
sequence. A sequence may contain as many as nine 2’s, for example, if the winner 
refuses the first nine CDs and chooses three copies of CD number 10. Our model 
for counting the number of ways a prize winner can choose her three CDs is the 
following. Each three-CD selection can be represented by an array containing 
three 1’s and nine 2’s or blanks, or a total of 12 cells. Some possible records are 
222122122221 (selecting number 4, 6, 10), 1211bbbbbbbb (selecting number 1 and 
two copies of number 2), and 222222222111 (selecting three copies of number 
10). The number of ways to select three cells of the array to hold 1’s is ,,C; since 
the array has 3 + 9 or 12 cells, and the order in which this selection is made does 
not matter. 


Theorem 2. Suppose that k selections are to be made from n items without regard 
to order and that repeats are allowed, assuming at least k copies of each of the n 
items. The number of ways these selections can be made is 4.4 —1)Cy- o 
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Example 4. In how many ways can a prize winner choose three CDs from the 
Top Ten list if repeats are allowed? 


Solution: Here nis 10 and k is 3. By Theorem 2, there are j9 43 -1C, or Cy 
ways to make the selections. The prize winner can make the selection in 220 
ways. Sd 


In general, when order matters, we count the number of sequences or per- 
mutations; when order does not matter, we count the number of subsets or combi- 
nations. 

Some problems require that the counting of permutations and combina- 
tions be combined or supplemented by the direct use of the addition or the mul- 
tiplication principle. 


Example 5. Suppose that a valid computer password consists of seven charac- 
ters, the first of which is a letter chosen from the set {A, B, C, D, E, F, G}, and the 
remaining six characters are letters chosen from the English alphabet or a digit. 
How many different passwords ere possible? 


Solution: A password can be constructed by performing the tasks 7, and 
T, in sequence. 


Task T,: Choose a starting letter from the set given. 
Task T,: Choose a sequence of letters and digits. Repeats are allowed. 


Task T, can be performed! in ,C, or seven ways. Since there are 26 letters 
and 10 digits that can be chosen for each of the remaining six characters, 
and since repeats are allowed, task 7, can be performed in 36° or 
2,176,782,336 ways. By the raultiplication principle, there are 7 - 2176782336 
or 15,237,476,352 differen: sasswords, oa 


Example 6. How many different seven-person committees can be formed each 
containing 3 women from an available set of 20 women and 4 men from an avail- 
able set of 30 men? 


Solution: In this case a committee can be formed by performing the fol- 
lowing two tasks in succession: 


Task 1: Choose 3 women from the set of 20 women. 
Task 2: Choose 4 men from the set of 30 men. 


Here order does not matter in the individual choices, so we are merely 
counting the number of possible subsets. Thus task 1 can be performed in 
a9C; Or 1140 ways and task 2 can be performed in 3)C, or 27,405 ways. By 
the multiplication principle, there are (1140)(27405) or 31,241,700 different 
committees. 6 


EXERCISE SET 3.2 


1. 


2. 


3. 


w 


6. 


7. 


- 


Compute each of the following. 
(a) 7C, (b) 7C, (c) Cs 
(d) nCn-1 (e) nCn—2 (f) nt1Cn~1 


Show that ,C, = ,C,_,- 


In how many ways can a committee of three 
faculty members and two students be selected 
from seven faculty members and eight students? 


In how many ways can a 6-card hand be dealt 
from a deck of 52 cards? 


At a certain college, the housing office has 
decided to appoint, for each floor, one male 
and one female residential advisor. How many 
different pairs of advisors can be selected for a 
seven-story building from 12 male candidates 
and 15 female candidates? 


A microcomputer manufacturer who is design- 

ing an advertising campaign is considering six 

magazines, three newspapers, two television sta- 

tions, and four radio stations. In how many 

ways can six advertisements be run if 

(a) all six are to be in magazines? 

(b) two are to be in magazines, two are to be in 
newspapers, one is to be on television, and 
one is to be on radio? 


How many different 8-card hands with 5 red 
cards and 3 black cards can be dealt from a 
deck of 52 cards? 


(a) Find the number of subsets of each possible 
size of a set containing four elements. 

(b) Find the number of subsets of each possible 
size for a set containing ” elements. 


An urn contains 15 balls, 8 of which are red and 
7 are black. In how many ways can 5 balls be 
chosen so that 

(a) all 5 are red? 

(b) all 5 are black? 

(c) 2 are red and 3 are black? 

(d) 3 are red and 2 are black? 
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10. In how many ways can a committee of 6 people 


11. 


be selected from a group of 10 people if one 
person is to be designated as chair of the com- 
mittee? 


A gift certificate at a local bookstore allows the 
recipient to choose 6 books from the combined 
list of 10 best-selling fiction books and 10 best- 
selling nonfiction books. In how many different 
ways can the selection of 6 books be made? 


. The college food plan allows a student to 


13. 


14. 


15 


? 


16. 


17 


° 


choose three pieces of fruit each day. The fruits 
available are apples, bananas, peaches, pears, 
and plums. For how many days can a student 
make a different selection? 


Show that , ,,C,=,C,_, +, 


avro1 avr 


(a) How many ways can a student choose 8 out 
of 10 questions to answer on an exam? 

(b) How many ways can a student choose 8 out 
of 10 questions to answer on an exam if the 
first 3 questions must be answered? 


Five fair coins are tossed and the results are 

recorded. 

(a) How many different sequences of heads 
and tails are possible? 

(b) How many of the sequences in part (a) 
have exactly one head recorded? 

(c) How many of the sequences in part (a) 
have exactly three heads recorded? 


Three fair six-sided dice are tossed and the 

numbers showing on top are recorded. 

(a) How many different record sequences are 
possible? 

(b) How many of the records in part (a) con- 
tain exactly one six? 

(c) How many of the records in part (a) con- 
tain exactly two fours? 


If n fair coins are tossed and the results recorded, 
how many 
(a) record sequences are possible? 
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(b) sequences contain exactly three tails, 19. How many ways can you choose three of seven 
assuming n = 3? fiction books and two of six nonfiction books to 
(c) sequences contain exactly & heads, assum- take with you on your vacation? 
ingn = k? 
20. For the driving part of your vacation you will 
18. If x fair six-sided dice are tossed and the num- take 6 of the 35 rock cassettes in your collec- 
bers showing on top are recorded, how many tion, 3 of the 22 classical cassettes, and 1 of the 
(a) record sequences are possible? 8 comedy cassettes. In how many ways can you 
(b) sequences contain exactly one six? make your choices? 


(c) sequences contain exactly four twos, assum- 


ingn 24? 


3.3. The Pigeonhole Principle 


In this section we introduce another proof technique, one that makes use of the 
counting methods we have discussed. 


Theorem 1 (The Pigeonhole Principle). fn pigeons are assigned to m pigeon- 
holes, and m <n, then at least one pigeonhole contains two or more pigeons. 


Proof: Consider labeling the m pigeonholes with the numbers 1 through 
m and the nv pigeons with -he numbers 1 through n. Now, beginning with 
pigeon 1, assign each pigeon in order to the pigeonhole with the same 
number, This assigns as many pigeons as possible to individual pigeon- 
holes, but because m <n, there are n — m pigeons that have not yet been 
assigned to a pigeonhole. At least one pigeonhole will be assigned a second 
pigeon. ¢ 


This informal and almost trivial sounding theorem is easy to use and has 
unexpected power in proving interesting consequences. 


Example 1. [f eight people are chosen in any way from some group, at least two 
of them will have been born on the same day of the week. Here each person 
(pigeon) is assigned to the day of the week (pigeonhole) on which he or she was 
born. Since there are eight people and only seven days of the week, the pigeon- 
hole principle tells us at least two people must be assigned to the same day of the 
week, ° 


Note that the pigeonhole principle provides an existence proof; there must 
be an object or objects with a certain characteristic. In Example 1, this charac- 
teristic is having been born on the same day of the week. The pigeonhole princi- 
ple guarantees that there are at least two people with this characteristic, but gives 
no information on identifying these people. Only their existence is guaranteed. In 
contrast, a constructive proof guarantees the existence of an object or objects 
with a certain characteristic by actually constructing such an object or objects. For 
example, we could prove that, given two rational numbers p and q, there is a ra- 
tional number between them by showing that pra is between p and q. 

To use the pigeonhole principle, we must identify pigeons (objects) and 
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pigeonholes (categories of the desired characteristic) and be able to count the 
number of pigeons and the number of pigeonholes. 


Example 2. Show that if any five numbers from 1 to 8 are chosen, then two of 
them will add up to 9. 


Solution: Construct four different sets, each containing two numbers that 
add up to 9 as follows: A; = {1,8}, A, = {2, 7}, A; = (3, 6}, A, = (4, 5}. Each 
of the five numbers chosen must belong to one of these sets. Since there are 
only four sets, the pigeonhole principle tells us that two of the chosen num- 
bers belong to the same set. These numbers add up to 9. Sd 


Example 3. Show that if any 11 numbers are chosen from the set {1,2,..., 20}, 
then one of them will be a multiple of another. 


Solution: Every positive integer can be written as n = 2*m, where mm is 
odd and k = 0. This can be seen by simply factoring all powers of 2 (if any) 
out of 7. In this case let us call m the odd part of x. If 11 numbers are cho- 
sen from the set {1, 2,..., 20}, then two of them must have the same odd 
part. This follows from the pigeonhole principle since there are 11 numbers 
(pigeons), but only 10 odd numbers between 1 and 20 (pigeonholes) that 
can be odd parts of these numbers. 

Let n, and 7, be two chosen numbers with the same odd part. We must 
have n, = 21m and n, = 2*2m, for some k, and k,. If k, = k,, then 7, is a 
multiple of n,; otherwise, 7, is a multiple of ny. ° 


Example 4. Consider the region shown in Figure 3.2. It is bounded by a regular 
hexagon whose sides are of length 1 unit. Show that if any seven points are cho- 
sen in this region, then two of them must be no farther apart than 1 unit. 


Solution: Divide the region into six equilateral triangles, as shown in 
Figure 3.3. If seven points are chosen in the region, we can assign each of 
them to a triangle that contains it. If the point belongs to several triangles, 
arbitrarily assign it to one of them. Then the seven points are assigned to six 
triangular regions, so by the pigeonhole principle at least two points must 
belong to the same region. These two cannot be more than 1 unit apart. 
Why? Sd 


Figure 3.2 Figure 3.3 


Example 5. Shirts numbered consecutively from 1 to 20 are worn by the 20 
members of a bowling league. When any 3 of these members are chosen to be a 
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team, the sum of their shirt numbers is used as a code number for the team. Show 
that if any 8 of the 20 are selectzd, then from these 8 we may form at least two 
different teams having the same code number. 


Solution: From the 8 selected bowlers, we can form a total of gC; or 56 dif- 
ferent teams. These will play the role of pigeons. The largest possible team 
code number is 18 + 19 -- 20 or 57, and the smallest possible is 1 + 2 + 3 
or 6. Thus only the 52 code numbers (pigeonholes) between 6 and 57 inclu- 
sive are available for the 56 possible teams. By the pigeonhole principle, at 
least two teams will have the same code number. Sd 


The Extended Pigeonhole Principle 


Note that if there are m pigeonholes and more than 2m pigeons, then three or 
more pigeons will have to be assigned to at least one of the pigeonholes. 
(Consider the most even distribution of pigeons you can make.) In general, if the 
number of pigeons is much larger than the number of pigeonholes, Theorem 1 
can be restated to give a stronger conclusion. 

First, a word about notation. If n and m are positive integers, then Lx/m1] 
stands for the largest integer less than or equal to the rational number n/m. Thus 
L3/2Jis 1, 9/4] is 2, and |.6/3. is 2. 


Theorem 2 (The Extended Pigeonhole Principle). /f n pigeons are assigned to 
m pigeonholes, then one of the pigeonholes must contain at least (n — 1)/m]| + 1 
pigeons. 


Proof (by contradiction): If each pigeonhole contains no more than 
L(x — 1)/m] pigeons, then there are at most m+ Lim — 1)/ml = 
m+ (a — 1)/m =n — 1 pigeons in all. This contradicts our assumptions, so 
one of the pigeonholes must contain at least L(x — 1)/m]+1 pigeons. @ 


Example 6. We give an extensicn of Example 1. Show that if any 30 people are 
selected, then we may choose a subset of 5 so that all 5 were born on the same 
day of the week. 


Solution: Assign each person to the day of the week on which she or 
he was born. Then 30 pigeons are being assigned to 7 pigeonholes. By 
the extended pigeonhole principle with n = 30 and m = 7, at least 
L(30 — 1)/7] + 1 or 5 of the people must have been born on the same day 
of the week. ¢ 


Example 7. Show that if 30 dictionaries in a library contain a total of 61,327 
pages, then one of the dictionaries must have at least 2045 pages. 


Solution: Let the pages be the pigeons and the dictionaries the pigeon- 
holes. Assign each page to the dictionary in which it appears. Then, by the 
extended pigeonhole principle, one dictionary must contain at least 
|61,326/30] + 1 or 2045 peges. o 


EXERCISE SET 3.3 


1. 


N 


~~ 
° 


If 13 people are assembled in a room, show that 
at least 2 of them must have their birthday in 
the same month. 


Show that if seven numbers from 1 to 12 are 
chosen, then two of them will add up to 13. 


Let T be an equilateral triangle whose sides are 
of length 1 unit. Show that if any five points are 
chosen lying on or inside the triangle, then two 

of them must be no more than 5 unit apart. 


. Show that if any eight positive integers are cho- 


sen, two of them will have the same remainder 
when divided by 7. 


. Show that if seven colors are used to paint 50 


bicycles, at least 8 bicycles will be the same color. 


Ten people volunteer for a three-person com- 
mittee. Every possible committee of three that 
can be formed from these 10 names is written 
on a slip of paper, one slip for each possible 
committee, and the slips are put in 10 hats. 
Show that at least one hat contains 12 or more 
slips of paper. 


Six friends discover that they have a total of 
$21.61 with them on a trip to the movies. Show 
that one or more of them must have at least 
$3.61. 


A store has an introductory sale on 12 types of 
candy bars. A customer may choose one bar of 
any five different types and will be charged no 
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11. 


13. 


14. 


15. 
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more than $1.75, Show that, although different 
choices may cost different amounts, there must 
be at least two different ways to choose so that 
the cost will be the same for both choices. 


If the store in Exercise 8 allows repetitions in 
the choices, show that there must be at least 10 
ways to make different choices that have the 
same cost. 


Show that there must be at least 90 ways to 
choose six numbers from 1 to 15 so that all the 
choices have the same sum. 


How many friends must you have to guarantee 
that at least five of them will have birthdays in 
the same month? 


Show that if five points are selected in a square 
whose sides have length 1 inch, at least two of the 
points must be no more than V2 inches apart. 


Prove that if any 14 numbers from 1 to 25 are 
chosen, then one of them is a multiple of another. 


Twenty cards numbered 1 through 20 are placed 
face down on a table, Cards are selected one at 
a time and turned over until 10 cards have been 
chosen. If two of the cards add up to 21, the 
player loses. Is it possible to win this game? 


Suppose that the game in Exercise 14 has been 
changed so that 12 cards are chosen. Is it possi- 
ble to win this game? 


Another area where counting techniques are important is probability theory. In 
this section we present a brief introduction to probability. 

Many experiments do not yield exactly the same results when performed 
repeatedly. For example, if we toss a coin, we are not sure if we will get heads or 
tails, and if we toss a die, we have no way of knowing which of the six possible 
numbers will turn up. Experiments of this type are called probabilistic, in contrast 
to deterministic experiments, whose outcome is always the same. 
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Sample Spaces 


A set A consisting of all the outcomes of an experiment is called a sample space 
of the experiment. With a given experiment, we can often associate more than 
one sample space, depending on what the observer chooses to record as an out- 
come. 


Example 1. Suppose that a ickel and a quarter are tossed in the air. We 
describe three possible sample spaces that can be associated with this experi- 
ment. 


1. If the observer decides to record as an outcome the number of heads 
observed, the sample space is A = {0, 1, 2}. 

2. If the observer decides to record the sequence of heads (H) and tails (T) 
observed, listing the condition of the nickel first and then that of the 
quarter, then the sample space is A = (HH, HT, TH, TT}. 

3. If the observer decides to record the fact that the coins match (M) or do 
not match (N), then the sample space is A = {M, N}. 


We thus see that, in addition to describing the experiment, we must indicate 
exactly what the observer wishes to record. Then the set of all outcomes of this 
type becomes the sample space for the experiment. 

A sample space may contain a finite or an infinite number of outcomes. 


Example 2. Determine the sample space for an experiment consisting of toss- 
ing a six-sided die twice and recording the sequence of numbers showing on the 
top face of the die after each toss. 


Solution: An outcome of the experiment can be represented by an 
ordered pair of numbers (7, 7), where n and m can be 1,2, 3, 4,5, or 6. Thus 
the sample space A contairs 6 X 6 or 36 elements (by the multiplication 
principle). Sd 


Example3. An experiment consists of drawing three coins in succession from a 
box containing four pennies and five dimes and recording the sequence of results. 
Determine the sample space of this experiment. 


Solution: An outcome car. be recorded as a sequence of length 3 con- 
structed from the letters P (penny) and D (dime). Thus the sample space A 
is 


{PPP, PPD, PDP. PDD, DPP, DPD, DDP, DDD}. ¢ 


Events 


A statement about the outcome of an experiment, which for a particular outcome 
will be either true or false, is said to describe an event. Thus, for Example 2, the 
statements “Each of the numbers recorded is less than 3” and “The sum of the 
numbers recorded is 4” would describe events. The event described by a state- 
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ment is taken to be the set of all outcomes for which the statement is true. With 
this interpretation, any event can be considered a subset of the sample space. 
Thus the event E described by the first statement is E = {(1, 1), (1, 2), (2, 1), 
(2, 2)}. Similarly, the event F described by the second statement is F = {(1, 3), 


(2, 2), (3, 1)}. 


Example 4. Consider the experiment in Example 2. Determine the events 
described by each of the following statements. 
(a) The sum of the numbers showing on the top faces is 8. 


(b) The sum of the numbers showing on the top faces is at least 10. 


Solution: (a) The event consists of all ordered pairs whose sum is 8. Thus 
the event is {(2, 6), (3, 5), (4, 4), (5, 3), (6, 2)}. 

(b) The event consists of all ordered pairs whose sum is 10, 11, or 12. Thus 
the event is {(4, 6), (5, 5), (5, 6), (6, 4), (6, 5), (6, 6)}. Sa 


If A is asample space of an experiment, then A itself is an event called the 
certain event, and the empty subset of A is called the impossible event. 

Since events are sets, we can combine them by applying the operations of 
union, intersection, and complementation to form new events. The sample space 
A is the universal set for these events. Thus, if E and F are events, we can form 
the new events E U F, EM F, and E. What do these new events mean in terms of 
the experiment? An outcome of the experiment belongs to & U F when it belongs 
to E or F (or both). In other words, the event E U F occurs exactly when E or F 
occurs. Similarly, the event E 9 F occurs if and only if both EF and F occur. Finally, 
E occurs if and only if E does not occur. 


Example 5. Consider the experiment of tossing a die and recording the number 
on the top face. Let E£ be the event that the number is even, and let F be the event 
that the number is prime. Then E = {2, 4,6} and F = {2,3, 5}. The event that the 
number showing is either even or prime is E U F = {2,3, 4,5, 6}. The event that 
the number showing is an even prime is E % F = {2}. Finally, the event that the 
number showing is not even is £& = {1, 3,5}, and the event that the number show- 
ing is not prime is F = (1, 4, 6}. a 


Events £ and F are said to be mutually exclusive or disjoint if LM F = { }. 
If £ and F are mutually exclusive events, then & and F cannot both occur at the 
same time; if E occurs, then F does not occur, and if F occurs, then E does not. If 
E,, E,,..., E,, are all events, then we say that these sets are mutually exclusive, 
or disjoint, if each pair of them is mutually exclusive. Again, this means that at 
most one of the events can occur on any given outcome of the experiment. 


Assigning Probabilities to Events 


In probability theory, we assume that each event E has been assigned a number 
p(E) called the probability of the event E. We now look at probabilities. We will 
investigate ways in which they can be assigned, properties that they must satisfy, 
and the meaning that can be given to them. 
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The number p(£) reflects our assessment of the likelihood that the event 
E will occur. More precisely, suppose that the underlying experiment is per- 
formed repeatedly and that, afte n such performances, the event E has occurred 
n, times. Then the fraction f, = ,/n, called the frequency of occurrence of E in 
n trials, is a measure of the likelihood that E will occur. When we assign the prob- 
ability p(£) to the event £, it neans that in our judgment or experience we 
believe that the fraction f, will tend ever closer to a certain number as n becomes 
larger and that p(£) is this number. Thus probabilities can be thought of as ide- 
alized frequencies of occurrence of events, to which actual frequencies of occur- 
rence will tend when the experinient is performed repeatedly. 


Example 6. Suppose that an experiment is performed 2000 times; the frequency 
of occurrence f; of an event £ is recorded after 100,500, 1000, and 2000 trials, and 
Table 3.1 summarizes the results. 


Table 3.1 
Number of Repetitions 
of the Experiment Np fe=np/n 
100 48 0.48 
500 259 0.518 
1000 496 0.496 


2000 1002 0.501 


Based on this table, it appears that the frequency f, approaches 5 as n becomes 
larger. It could therefore be argued that p(£) should be set equal to 5. On the 
other hand, we might require more extensive evidence before assigning 
5 as the value of p(£). In any case, this sort of evidence can never “prove” that 
P(E) is i. It only serves to make this a plausible assumption. ° 


If probabilities assigned to various events are to represent meaningfully 
frequencies of occurrence of the events, as explained previously, then they can- 
not be assigned in a totally arbitrary way. They must satisfy certain conditions. 
First, since every frequency f, must satisfy the inequalities of 0 =f, = 1, it is only 
reasonable to assume that 


Pl: 0=p(£):s1_ for every event Ein A. 


Also, since the event A must occur every time (every outcome belongs to A), and 
the event @ cannot occur, we assume that 


P2: p(A)=1 and p(@)=0. 
Finally, if E,, £,,..., &, are mutuélly exclusive events, then 


Ne RU UE) = Me, + Mg, to + Ne, 
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since only one of these events can occur at a time. If we divide both sides of this 
equation by n, we see that the frequencies of occurrence must satisfy a similar 
equation. We therefore assume that 


P3: p(E, UE, U++-U E,) = p(E,) + p(E,) + +++ + p(E,) 


whenever the events are mutually exclusive. If the sample space is finite and the 
probabilities are assigned to all events in such a way that P1, P2, and P3 are 
always satisfied, then we have a probability space. We call P1, P2, and P3 the 
axioms for a probability space. 

It is important to realize that, mathematically, no demands are made on a 
probability space except those given by the probability axioms P1, P2, and P3. 
Probability theory begins with all probabilities assigned and then investigates the 
consequences of and relations among these probabilities. No mention is made of 
how the probabilities were assigned. However, the mathematical conclusions will 
be useful in an actual situation only if the probabilities assigned reflect what actu- 
ally occurs in that situation. 

Experimentation is not the only way to determine reasonable probabilities 
for events. The probability axioms can sometimes provide logical arguments for 
choosing certain probabilities. 


Example 7. Consider the experiment of tossing a coin and recording whether 
heads or tails results, Consider the events E: heads turns up and F: tails turns up. 
The mechanics of the toss are not controllable in detail. Thus, in the absence of 
any defect in the coin that might unbalance it, we may argue that E and F are 
equally likely to occur. There is a symmetry in the situation that makes it impos- 
sible to prefer one outcome over the other. This argument lets us compute what 
the probabilities of FE and F must be. 

We have assumed that p(£) = p(F), and it is clear that E and F are mutu- 
ally exclusive events and A = £ U F. Thus, using the properties P2 and P3, we see 
that 


1 = p(A) = p(E) + p(F) = 2p(E), since p(E) = p(F). 


This shows that p(E) = ; = p(F). We may often assign appropriate probabilities 
to events by combining the symmetry of situations with the axioms of probability. 
4 


Finally, we will show that the problem of assigning probabilities to events 
can be reduced to the consideration of the simplest cases. Let A be a probability 
space. We assume that A is finite; that is, A = {x,,x,,...,x,,]. Then each event {x,}, 
consisting of just one outcome, is called an elementary event. For simplicity, let us 
write p, = p({x,}). Then p, is called the elementary probability corresponding to 
the outcome x,. Since the elementary events are mutually exclusive and their 
union is A, the axioms of probability tell us that 


EP1: O0<p,<1, forallk 
EP2: p,+pyt+:::+p,=1. 
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if E is at event in A, say FE = = (Xd iy «+> X;,), then we can write E = [x,} U 
{x,,} U---U {x,,}. This means. by axiom P2, that p(E) = Pi, + Pip 00 + Pi, Thus, 
if we ae the elementary probabilities, then we can compute the probability of 
any event EF. 


Example 8. Suppose that an experiment has a sample space A = {1, 2,3, 4, 5, 6} 
and that the elementary probabilities have been determined as follows: 


1 1 1 1 1 1 
Pi 12’ P2 1 P3 > Ps 6° Ps 4 Pe 49 


Let E be the event “The outcora2 is an even number.” Compute p(£). 


Solution: Since E = {2,4 6}, we see that p(E) =p, + pat po=atet 
a or 4. In a similar way. we can determine the probability of any event in A. 
Sd 


Thus we see that the problem of assigning probabilities to all events in a 
consistent way can be reduced to the problem of finding numbers p,, p,,..., P, 
that satisfy EP1 and EP2. Again, mathematically speaking, there are no other 
restrictions on the p,’s. However. if the mathematical structure that results is to 
be useful in a particular situatior.,, then the p,’s must reflect the actual behavior 
occurring in that situation. 


Equally Likely Outcomes 


Let us assume that all outcomes in a finite sample space A are equally likely to 
occur. This is, of course, an assuniption and so cannot be proved. We would make 
such an assumption if experimental evidence or symmetry indicated that it was 
appropriate in a particular situation (see Example 7). Actually, these situations 
arise commonly. One additional piece of terminology is customary. Sometimes 
experiments involve choosing an object, in a nondeterministic way, from some 
collection. If the selection is made in such a way that all objects have an equal 
probability of being chosen, we say that we have made a random selection or 
have chosen an object at random from the collection. We will often use this ter- 
minology to specify examples of experiments with equally likely outcomes. 
Suppose that | A| = 7 and these n outcomes are equally likely. Then the ele- 
mentary probabilities are all equal, and since they must add up to 1, this means 
that each elementary probability is 1/n. Now let E be an event that contains k 


outcomes, say & = {x,,.%),....x,}. Since all elementary probabilities are 1/n, we 
must have 
tL 1 1 ek 
P(E) =—-+>4-5-4+>=-. 
non non 
eee pee ae 
& summands 


Since k = |E|, we have the following principle: If all outcomes are equally likely, 
then for every event F 
|E| _ total number of outcomes in E 


E pra 
pte [Al total number of outcomes 
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In this case, the computation of probabilities reduces to counting numbers 
of elements in sets. For this reason, the methods of counting discussed in the 
earlier sections of this chapter are quite useful. 


Example 9. Choose 4 cards at random from a standard 52-card deck. What is 
the probability that four kings will be chosen? 


Solution: The outcomes of this experiment are 4-card hands; each is 
equally likely to be chosen. The number of 4-card hands is ,,C, or 270,725. 
Let E be the event that all 4 cards are kings. The event £ contains only one 
outcome. Thus p(E) = as or approximately 0.000003694. This is an 
extremely unlikely event. a 


Example 10. A box contains six red balls and four green balls. Four balls are 
selected at random from the box. What is the probability that two of the selected 
balls will be red and two will be green? 


Solution: The total number of outcomes is the number of ways to select 
four objects out of ten, without regard to order. This is ,C, or 210. Now the 
event E, that two of the balls are red and two of them are green, can be 
thought of as the result of performing two tasks in succession. 


Task 1: Choose two red balls from the six red balls in the box. 
Task 2: Choose two green balls from the four green balls in the box. 


Task 1 can be done in (C, or 15 ways and task 2 can be done in ,C, or 6 
ways. Hence the event & can occur in 15 - 6 or 90 ways and, therefore, 


p(E) = 35 0r3. ¢ 


Example 11. A fair six-sided die is tossed three times and the resulting 
sequence of numbers is recorded. What is the probability of the event F that 
either all three numbers are equal or none of them is a 4? 


Solution: Since the die is assumed to be fair, all outcomes are equally likely. 
First, we compute the total number of outcomes of the experiment. This is 
the number of sequences of length 3, allowing repetitions, that can be con- 
structed from the set {1, 2, 3, 4, 5, 6}. This number is 6? or 216. 

Event E cannot be described as the result of performing two successive 
tasks as in Example 10. We can, however, write E as the union of two sim- 
pler events. Let F be the event that all three numbers recorded are equal, 
and let G be the event that none of the numbers recorded is a 4. 
Then E = F U G. By the addition principle (Theorem 2, Section 1.2), 
IFUG|=|F[+|G|-|FNG,. 

There are only six outcomes in which the numbers are equal, so |F| is 6. 
The event G consists of all sequences of length 3 that can be formed from 
the set {1, 2, 3, 5, 6}. Thus | G| is 5°, or 125. Finally, the event FM G consists 
of all sequences for which the three numbers are equal and none is a 4. 
Clearly, there are five ways for this to happen, so |F M G| is 5S. Using the 
addition principle, |E| = |F U G| = 6 + 125 — 5, or 126. Thus we have 


7 
p(E) = Hg org. Co 
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Example 12. Consider again the experiment in Example 10 in which four balls 
are selected at random from a box containing six red balls and four green balls. 
(a) If E is the event that no more than two of the balls are red, compute the 


probability of E. 


(b) If F is the event that no more than three of the balls are red, compute the 


probability of F. 


Solution: (a) Here E car. oe decomposed as the union of mutually exclu- 
sive events. Let E, be the event that none of the chosen balls is red, let E, 
be the event that exactly one of the chosen balls is red, and let E, be the 
event that exactly two of the chosen balls are red. Then £o, E;, and E, are 
mutually exclusive and E -= E, U E, U E,. Using the addition principle 
twice, |E| =/E,|+|£,| + U,|. If none of the balls is red, then all four must 
be green. Since there are ordy four green balls in the box, there is only one 
way for event E, to occur. Thus | Fy| = 1. If one ball is red, then the other 
three must be green. To make such a choice, we must choose one red ball 
from a set of six, and then three green balls from a set of four. Thus the 
number of outcomes in F, is (,C,)(,C3) or 24. 

In exactly the same way, we can show that the number of outcomes in E, 
is (¢Cy)(4Cs) or 90. Thus | £} = 1 + 24 + 90 or 115. On the other hand, the 
total number of ways of choosing four balls from the box is ;9C, or 210, so 
P(E) = 79 OF 

(b) We could compute | F| in the same way we computed | E| in part (a) 
by decomposing F into four mutually exclusive events. The analysis would, 
however, be even longer than that of part (a). We choose instead to illus- 
trate another approach that is frequently useful. 

Let F be the complementary event to F. Since F and F are mutually exclu- 
sive and their union is the sample space, we must have p(F) + p(F) = 1. This 
formula holds for any event F and is used when the complementary event 
is easier to analyze. This is the case here, since F is the event that 
all four balls chosen are zed. These four red balls can be chosen from 
the six red balls in ,C, or 15 ways, so p(F) = # or i: This means that 
p(F)=1-fork. ey 


EXERCISE SET 3.4 


In Exercises 1 through 6, describe the associated 3. A marketing research firm conducts a survey in 


sample space. 


which people are classified according to the fol- 
lowing characteristics. 


1. Ina class of 10 students, the instructor records Gender: male (sm), female (f) 
the number of students present on a given day. Income level: low (/), middle (a), upper () 


Smoker: yes (y), no (7) 


2. A coin is tossed three times and the sequence A person is selected at random and classified 
of heads and tails is recorded. accordingly. 


< 


10. 


11. 


. Two letters are selected simultaneously at ran- 


dom from the letters a, b, c, d. 


A silver urn and a copper urn contain blue, red, 
and green balls. An urn is chosen at random and 
then a ball is selected at random from this urn. 


. A box contains 12 items, 4 of which are defec- 


tive. An item is chosen at random and not 
replaced. This is continued until all four defec- 
tive items have been selected. The total number 
of items selected is recorded. 


. (a) Suppose that the sample space of an exper- 


iment is {1, 2,3}. Determine all possible 
events. 

(b) Let S be a sample space containing n ele- 
ments. How many events are there for the 
associated experiment? 


. An experiment consists of tossing a die and 


recording the number on the top face. 

Determine each of the following events. 

(a) E: The number tossed is at least 4. 

(b) F: The number tossed is less than 3. 

(c) G:The number tossed is either divisible by 
3 or is a prime. 


A card is selected at random from a standard 
deck. Let £, F, and G be the following events. 


E: The card is black. 
F:The card is a diamond. 
G: The card is an ace. 


Describe the following events in complete sen- 
tences. 

(a) EUG 

(d) EUFUG 


(b) ENG () ENG 
(ec) EUFUG 


A die is tossed twice and the numbers showing 
on the top faces are recorded in sequence. 
Determine the elements in each of the given 
events. 

(a) At least one of the numbers is a 5. 

(b) At least one of the numbers is an 8. 

(c) The sum of the numbers is less than 7. 

(d) The sum of the numbers is greater than 8. 


A die is tossed and the number showing on the 
top face is recorded. Let E, F, and G be the fol- 
lowing events. 


14. 
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E: The number is at least 3. 
F: The number is at most 3. 
G. The number is divisible by 2. 


(a) Are £ and F mutually exclusive? Justify 
your answer. 

(b) Are F and G mutually exclusive? Justify 
your answer. 

(c) Is £ U F the certain event? Justify your 
answer. 

(d) Is EN F the impossible event? Justify your 
answer. 


. Let E be an event for an experiment with sam- 


ple space A. Show that 
(a) EU Eis the certain event. 
(b) EA Eis the impossible event. 


A medical team classifies people according to 
the following characteristics. 

Drinking habits: drinks (d), abstains (a) 

Income level: low (/), middle (7m), upper (u) 

Smoking habits: smoker (s), nonsmoker () 
Let E, F, and G be the following events. 

E: A person drinks. 

F: A person’s income level is low. 

G: A person smokes. 


List the elements in each of the following events. 
(a) EUF (b) ENF (c) (EUG)OF 


Let S = {1,2,3, 4,5, 6} be the sample space of 
an experiment and let 
E = {1,3, 4, 5}, F = (2, 3}, G= {4}. 


(a) Compute the events £ U F, EM F, and F, 
(b) Compute the following events: E U F and 
FOG. 


In Exercises 15 and 16, list the elementary 
events for the given experiment. 


15. 


16. 


A vowel is selected at random from the set of 
all vowels {a, e, i, 0, u}. 


A card is selected at random from a standard 
deck and it is recorded whether the card is a 
club, spade, diamond, or heart. 
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18. 


19. 


20. 


21. 


22. 
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When a certain defective die is tossed, the num- 
bers from 1 to 6 will be on the top face with the 
following probabilities: 


2 3 4 3 

Bim gg PE ger Fs age Pa Gp 
Sa <5 
Ps = 19 Po Tg 


Find the probability that 

(a) an odd number is on top. 

(b) a prime number is on top. 

(c) a number less than S is on top. 
(d) a number greater than 3 is on top. 


Repeat Exercise 17 assuming that the die is not 
defective. 


Suppose that F and F are mutually exclusive 
events such that p(£) = 0.3 and p(F) = 0.4. 
Find the probability that 
(a) E does not occur. 
(c) E or F occurs. 

(d) E does not occur or F does not occur. 


(b) E and F occur. 


Consider an experiment with sample space 
A= (1, A, X3, x4} for which 
2 3 1 1 


7 P3 7 P4 7 


Find the probability of the given event. 
(a) E = (x,,x)} (b) F = {%),x5, 24) 


There are four candidates for president, A, B, 
C, and D. Suppose that A is twice as likely to be 
elected as B, B is three times as likely as C, and 
C and D are equally likely to be elected. What 
is the probability of being elected for each can- 
didate? 


The outcome of a particular game of chance is 
an integer from 1 to S. Integers 1,2, and 3 are 
equally likely to occur, and integers 4 and 5 are 
equally likely to occur. The probability that the 
outcome is greater than 2 is z. Find the proba- 
bility of each possible outcome. 


. A fair coin is tossed five times. What is the prob- 


ability of obtaining three heads and two tails? 


24. A woman has five pairs of gloves in a drawer. If 


25. 


26. 


27. 


29. 


she selects two gloves at random, what is the 
probability that the gloves will be a matching 
pair? 


Suppose that a fair die is tossed and the num- 
ber showing on the top face is recorded. Let E, 
F,and G be the following events. 


E: (1,2,3,5},  F: {2, 4, G: {1, 4, 6}. 
Compute the probability of the event indicated. 
(a) EUF (b) ENF (ce) ENF 
EUG (e)EUG (ff) ENF 


Suppose that two dice are tossed and the num- 
bers on the top faces recorded. What is the 
probability that 

(a) a4 was tossed? 

(b) a prime number was tossed? 

(c) the sum of the numbers is less than 5? 

(d) the sum of the numbers is at least 7? 


Suppose that two cards are selected at random 
from a standard 52-card deck. What is the prob- 
ability that both cards are less than 10 and nei- 
ther of them is red? 


Suppose that three balls are selected at random 
from an urn containing seven red balls and five 
black balls. Compute the probability that 

(a) all three balls are red. 

(b) at least two balls are black. 

(c) at most two balls are black. 

(d) at least one ball is red. 


A basket contains three apples, five bananas, 
four oranges, and six pears. A piece of fruit is 
chosen at random from the basket. Compute 
the probability that 

(a) an apple or a pear is chosen. 

(b) the fruit chosen is not an orange. 


. A fair die is tossed three times in succession. 


Find the probability that the three resulting 
numbers 

(a) include exactly two 3’s. 

(b) form an increasing sequence. 

(c) include at least one 3. 

(d) include at most one 3. 

(e) include no 3’s. 
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3.5. Recurrence Relations 


The recursive definitions of sequences in Section 1.3 are examples of recurrence 
relations. When the problem is to find an explicit formula for a recursively 
defined sequence, the recursive formula is called a recurrence relation. 
Remember that to define a sequence recursively a recursive formula must be 
accompanied by information about the beginning of the sequence. This informa- 
tion is called the initial condition or conditions for the sequence. 


Example 1. (a) The recurrence relation a, = a,,_, + 3 with a, = 4 recursively 
defines the sequence 4, 7, 10, 13,.... The initial condition is a, = 4. 

(b) The recurrence relation f, = f,-, + f,-2 fi = fp = 1, defines the 
Fibonacci sequence 1, 1,2, 3,5, 8, 13,21,.... The initial conditions are f, = 1 and 
fp =. ¢ 


Recurrence relations arise naturally in many counting problems and in ana- 
lyzing programming problems. 


Example 2. Suppose that we wish to print out all z-element sequences that can 
be made from the set {1,2,3,...,}. One approach to this problem is to proceed 
recursively as follows. 


STEP 1. Produce a list of all sequences that can be made from {1, 2,3,..., 
n— i}. 


STEP 2, For each sequence in step 1, insert 1 in turn in each of the n available 
places (at the front, at the end, and between every pair of numbers in the 
sequence), print the result, and remove n. 


The number of insert-print-remove actions is the number of n-element 
sequences. It is also clearly n times the number of sequences produced in step 1. 
Thus we have 


number of n-element sequences = 1 X (number of (# — 1)-sequences). 


This gives a recursive formula for the number of n-element sequences. What is 
the initial condition? 


One technique for finding an explicit formula for the sequence defined by 
a recurrence relation is backtracking, as illustrated in the following example. 


Example 3. The recurrence relation a, = a,_, + 3 with a, = 2 defines the 
sequence 2,5, 8,.... We backtrack the value of a, by substituting the definition 
of a,,_;, 4,3, and so on, until a pattern is clear. 


a,=4,-,+3 or 4, =4a,_,+3 
=(4,-. +3) +3 =a,-.+2°3 
= ((a,-3 +3) +3) +3 =a,-3+3°3. 


= 
= 
( 
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Eventually, this process will preduce 
a, = Qn (n-1) + (n in 1) °3 
a,+(n-1)-3 
2+(n-1)°3. 
An explicit formula for the sequence is a, = 2 + (n — 1)3. Verify this. 


It 


Ui 


Example 4. Backtrack to find en explicit formula for the sequence defined by 
the recurrence relation b, = 2b,..; + 1 with initial condition b, = 7. 


Solution: We begin by substituting the definition of the previous term in 
the defining formula. 
b, = 2b,_,+ 1 

= 2(2b,-, +1) +1 

= 2(2(2b,-,+1)+1]+1 

= 23b,.,+44+24+1 

= 29b,-,+ 2? +2141. 
A pattern is emerging with these rewritings of b,. (Note: There are no set 


rules for how to rewrite these expressions and a certain amount of experi- 
mentation may be necessary.) The backtracking will end at 


BAP Deg oe es BD eT 
=2"-'b,+2"1—1  — Using Exercise 3, Section 2.4 
= 7-227 b 4 2R-t 4, 
Two useful summing rules were proved in the exercises in Section 2.4. We 
record them again for use in this section. 
a" —1 
a-1° 
_ a(n + 1) 
ae 


Sl. l+tat@t+ate ta t= 
$2; 14+2434---4n 


Backtracking may not reveal an explicit pattern for the sequence defined 
by a recurrence relation. We now introduce a more general technique for solving 
a recurrence relation. First, we give a definition. A recurrence relation is a linear 
homogeneous relation of degree & if it is of the form 


a, = 1,4, 1, + %)a,-. ++:++na,_,, Where the r’s are constants. 
Example 5 
(a) The relation c, = (-2)c,.., is a linear homogeneous recurrence relation of 
degree 1. 


(b) The relation a, = a,_, + 3 is not a linear homogeneous recurrence relation. 
(c) The recurrence relation f, = f,_, + f,, 2 is a linear homogeneous relation of 
degree 2. 
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(d) The recurrence relation g, = g2_, + g,_3 is not a linear homogeneous 
relation. a 


For a linear homogeneous recurrence relation of degree k, a, = ra,_, + 
Po,-9 +++ + ryG,—~, We call the associated polynomial of degree k, x* = 
nx*-l + rx*-2 + +++ + 1, its characteristic equation. The roots of the charac- 
teristic equation play a key role in the explicit formula for the sequence defined 
by the recurrence relation and the initial conditions. While the problem can be 
solved in general, we give a theorem for degree 2 only. Here it is common to write 
the characteristic equation as x? — r,x — r, = 0. 


Theorem 1 

(a) If the characteristic equation x° — r,x — r, = 0 of the recurrence rela- 
tion a, = 1,a,_-, + 1%4,_, has two distinct roots, s, and Ss, then a, = 
us{' + vs}, where u and v depend on the initial conditions, is the explicit 
formula for the sequence. 

(b) If the characteristic equation x° ~ r,x — ry) = 0 has a single root s, then 
the explicit formula is a, = us" + vns”", where u and v depend on the ini- 
tial conditions. 


2 


Proof: (a) Suppose that s? — rs, — r. = 0, s? — ns, — ry = 0, and 
a, = us? + vs}, for n = 1. We show that this definition of a, defines the 
same sequence asa, = 1r,a,_, + r,4,_3. First, we note that wu and v are cho- 
sen so that a, = us, + vs, and a) = us? + vs3 and the initial conditions are 


satisfied. Then 


a, = us" + vst Split out s7 and s3. 
= ust Psi + vst-7s5 Substitute for s3 and s3. 


= us? 2(r,5, + ry) + veh Ars) + 1) 

= n-l1 n-2 n~1 n-2 

= rus, +t rnus, ° + nvsz ° + rvs5 

= nol navi n-2 n-2 

=r,(us{* + vs37*) + r(ust* + vs5"*) 

= Nan-1 + 8n-2 Use definitions of a,_, 
and a,,_ >. 


(b) This part may be proved in a similar way. Sd 


Example 6. Find an explicit formula for the sequence defined by c, = 3c,_, — 
2c, With the initial conditions c,; = 5 and ¢, = 3. 

Solution: The recurrence relation c, = 3c,_, ~ 2c, _7 is a linear homoge- 
neous relation of degree 2. [ts associated equation is x? = 3x ~ 2. Rewriting 
this as x? — 3x + 2 = 0, we see there are two roots, 1 and 2. Theorem 1 says 
that we can find u and v so that ¢, = u(1) + v(2) and c, = u(1)? + v(2). 
Solving this 2 X 2 system yields u is 7 and v is —1. 

By Theorem 1, we have c, = 7-1" + (—1)- 2” orc, = 7 — 2”. Note that 
using ¢, = 3¢,, — 2c, _», with the initial conditions c, = 5 and c, = 3, gives 
5, 3, —1, and —9 as the first four terms of the sequence. The formula 
c, = 7 — 2" also produces 5,3, —1, and —9 as the first four terms. a 
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Example 7. Solve the recurrence relation d, = 2d, _, 
tions d, = 1.5 and d, = 3. 


— d,_, with initial condi- 


Solution: The associated. equation for this linear homogeneous relation is 
x? — 2x + 1 = 0. This equation has one (multiple) root, 1. Thus, by Theorem 


1(b), d, = u(1)" + va(l)". Using this formula and the initial conditions 
d,=15 =u + v(1) and d, = 3 = u + v(2), we find that wu is 0 and vis 1.5. 
Then d, = 1.51. a 


The Fibonacci sequence in Example 1(b) is a well-known sequence whose 
explicit formula took over two hundred years to find. 


Example 8. The Fibonacci sequence is defined by a linear homogeneous recur- 
rence relation of degree 2, so, by Theorem 1, the roots of the associated equation 
are needed to describe the explicit formula for the sequence. From f, = f,_, + 
f,-2 and f, = f, = 1, we have x’? — x — 1 = 0. Using the quadratic formula to 
obtain the roots, we find s, = L+V5 and s, = AVS It remains to determine the 


u and v of Theorem 1. We solve 
1+ V5 1- V5 1+V5\? (1 - V5\2 
l=u +y -| and l=u +p . 
2 2 Z 2 
The explicit formula for the 


LL 


EF : tos ial condi . ‘ th dvis — . 
‘or the given initial conditions, u SK and Vv 1s Va 


Fibonacci sequence is 
Parra (aE) am On Pe) 
ee ee a8 ae eee 


EXERCISE SET 3.5 


In Exercises 1 through 6, identify the given 


sequence defined by the recurrence relation and 


recurrence relation as linear homogeneous or 
not. If the relation is a linear homogeneous 
relation, give its degree. 


L. a, = 2.54, _ 4 


2. by = —3b,-1 — 2By 


In Exercises 7 through 12, use the technique of 
backtracking to find an explicit formula for the 


initial condition(s). 


7. a, = 2.5a,_1, 4, =4 


8. b, = 5b,-, +3, b, =2 


d,=5 


ao b 
UL. ¢, = e,-, — 2, e, =0 
32. 8, = NB, -1, 8 = 6 


In Exercises 13 through 18, solve each of the 
recurrence relations. 


13. a, = 4a,_, + Sa,_,, a, = 2, a, = 6 


14. b, = —3b,_, — 2b, _., by = —2, b, = 4 
15. c, = —6c,_, — 9¢,-, ¢; = 2.5, = 4.7 
16. d, = 4d,_, — 4d,_,, d, =1, d, =7 

17. ¢, = 2e,_» e, = V2, & =6 


18. Bn — 28a 1 = 28,2 a= 1, &=4 


KEY IDEAS FOR REVIEW 


¢ Theorem (multiplication principle of counting): 
Suppose that two tasks T, and T, are to be per- 
formed in sequence. If 7; can be performed in 
n, ways and for each of these ways 7, can be 
performed in n, ways, then the sequence 7,7, 


can be performed in n,n, ways. 


# Theorem (extended multiplication principle): 


see page 73 


@ Theorem: Let A be a set with n elements and 
1 =r =n. Then the number of sequences of 
length r that can be formed from elements of A, 


allowing repetitions, is n’. 


# Permutation of n objects taken r at a time 
(1 =r<n):asequence of length r formed from 


distinct elements 


¢ Theorem: If 1<r<=n, then ,P,, the number of 
permutations of # objects taken r at a time, is 


n-(n—1)+(n-2)---(n-r t+ lhor-2y 


(n - nt’ 


4 Permutation: an arrangement of n elements of 


a set A into a sequence of length n 


¢@ Theorem: The number of distinguishable per- 
mutations that can be formed from a collection 
of n objects where the first object appears k, 
times, the second object &, times, and so on, is 

Li 


Kyligh «ki * 


¢ Combination of 7 objects taken r at a time: a 
subset of r elements taken from a set with x 


elements 


# Theorem: Let A be a set with |A] = n and let 
1 =r =a. Then ,C,, the number of combina- 
tions of the elements of A, taken r at a time, is 


nt 


AG ~rne EB 
@ Theorem: Suppose that & selections are to be 


4 
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Key Ideas for Review 


19. Develop a general explicit formula for a nonho- 
mogeneous recurrence relation of the form 
a, = ra, _, + Ss, where r and s are constants, 


20. Confirm that the explicit formula of Example 8 
produces the Fibonacci sequence given in 
Example 1(b) by calculating the first five terms 
of the sequence. 


made from n items without regard to order and 
that repeats are allowed, assuming at least k 
copies of each of the n items. The number of 
ways these selections can be made is «4 x —1)Ci- 
The pigeonhole principle: see page 82 

The extended pigeonhole principle: see page 
84 

Sample space: the set of all outcomes of an 
experiment 

Event: a subset of the sample space 

Certain event: an event certain to occur 
Impossible event: the empty subset of the sam- 
ple space 

Mutually exclusive events: any two events EF 
and Fwith EN F = {(} 

fe: the frequency of occurrence of the event F 
in n trials 

p(E): the probability of event E 

Probability space: see page 89 

Elementary event: an event consisting of just 
one outcome 

Random selection: see page 90 

Recurrence relation: a recursive formula for a 
sequence 

Initial conditions: information about the begin- 
ning of a recursively defined sequence 

Linear homogeneous relation of degree k: a 
recurrence relation of the form 


a, =ha,-, + md,. t+ +r, ~ 


where the r,’s are constants. 


Characteristic equation: see page 97 
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CODING EXERCISES 


For each of the following, write the requested pro- 
gram or subroutine in pseudocode (as described in 
Appendix A) or in a programming language that you 
know. Test your code either with a paper-and-pencil 
trace or with a computer run. 


1, Write a subroutine that accepts two positive 
integers n and r and, ifr <n, returns the num- 
ber of permutations of ” objects taken r at a 
time. 


2. Write a program that has as input positive 
integers n and r and, if r = n, prints the per- 
mutations of 1,2,3,...,n taken rat a time. 


3. Write a subroutine that accepts two positive 


integers n and r and, if r =n, returns the num- 
ber of combinations of n objects taken r at a 
time. 


. Write a program that has as input positive 


integers n and r and, if r =< n, prints the combi- 
nations of 1,2,3,..., taken rat a time. 


. (a) Write a recursive subroutine that with 


input k prints the first kK Fibonacci num- 
bers. 

(b) Write a nonrecursive subroutine that with 
input k prints the kth Fibonacci number. 


CHAPTE 


Prerequisites: Chapters 1 and 2 


Relationships between people, numbers, sets, and many other entities can be for- 
malized in the idea of a binary relation. In this chapter we develop the concept 
of binary relation, and we give several geometric and algebraic methods of rep- 
resenting such objects. We also discuss a variety of different properties that a 
binary relation may possess, and we introduce important examples such as equiv- 
alence relations. Finally, we introduce several useful types of algebraic manipula- 
tions that may be performed on binary relations. We discuss these manipulations 
from both a theoretical and computational point of view. 


4.1. Product Sets and Partitions 


Product Sets 


An ordered pair (a, b) is a listing of the objects a and 5 in a prescribed order, with 
a appearing first and b appearing second. Thus an ordered pair is merely a 
sequence of length 2. From our earlier discussion of sequences (see Section 1.3), 
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it follows that the ordered pairs (a,, b,) and (a), b,) are equal if and only if a, = 
a, and b, = bp. 

If A and B are two nonempty sets, we define the product set or Cartesian 
product A x B as the set of all ordered pairs (a,b) with a € A and b € B. Thus 


AXB={(u,b)|aEA and bE B}. 
Example 1. Let 
A= {1,2,3} and B = {r,s}, 
then 
AX B= {(1,", (1,38), (2,7), (2,5), 3,7), B,s)}. 


Observe that the elements of A X B can be arranged in a convenient tabular 
array as shown in Figure 4.1. Sa 


2] (2,7 (2, s) 
3] Gr) G, s) 


Figure 4.1 


Example 2. If A and B are as in Example 1, then 
BXA = {(*, 1), (s, D, (7, 2), (8, 2), @, 3), (8, 3)}- . 
From Examples 1 and 2, we see that A X B need not equal B X A. 
Theorem 1. For any two fimtz, nonempty sets A and B,|A X B| = |A]|B]- 


Proof: Suppose that|A =m and|B| = n.To form an ordered pair (a, 5), 
a€ A and b € B, we must perform two successive tasks, Task 1 is to choose 
a first element from A, and task 2 is to choose a second element from B. 
There are m ways to perform task 1 and n ways to perform task 2; so, by the 
multiplication principle (see Section 3.1), there are m X n ways to form an 
ordered pair (a, b). In other words, |A X B| =m-n=|A||Bl. 5 


Example 3. If A = B = R. the set of all real numbers, then R X R, also de- 
noted by R’, is the set of all points in the plane. The ordered pair (a, b) gives the 
coordinates of a point in the plane. 


Example 4. A marketing research firm classifies a person according to the fol- 
lowing two criteria: 


Gender: male (m); female (f) 
Highest level of education completed: elementary school (e); 
high school (A); college (c); graduate school (g) 
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Let S = {m, f} and L = {e,h, c, g}. Then the product set S x L contains all 
the categories into which the population is classified. Thus the classification (f, g) 
represents a female who has completed graduate school. There are eight cate- 
gories in this classification scheme. od 


We now define the Cartesian product of three or more nonempty sets by 
generalizing the earlier definition of the Cartesian product of two sets, That is, the 
Cartesian product A, X A, x --: X A,, of the nonempty sets A,, A,,...,A,, is the 
set of all ordered m-tuples (a, a,...,4,,), where a; © A, i = 1,2,..., m. Thus 


A, X A,X KX Ay, = {(4, a. ,4,) | a; A,i=1,2,..., ma}. 


Example 5. A software firm provides the following three characteristics for 
each program that it sells: 


Language: FORTRAN (f); PASCAL (p); LISP (/) 
Memory: 2 meg (2), 4 meg (4); 8 meg (8) 
Operating system: UNIX (u); DOS (d) 


Let L = (fp, 1}, M = {2,4, 8}, and O = {u, d|. Then the Cartesian product 
LX M X O contains all the categories that describe a program. There are 
3-3-2 or 18 categories in this classification scheme. o 


Proceeding in a manner similar to that used to prove Theorem 1, using the 
extended multiplication principle, we can show that if A, has n, elements, A, has n, 
elements, ...,and A,, has n,, elements, then A, X A, X--: xX A,, hasn,+n.°°-n,, 
elements. 


Partitions 
A partition or quotient set of a nonempty set A is a collection of nonempty 


subsets of A such that 


1. Each element of A belongs to one of the sets in ?. 
2. If A, and A, are distinct elements of ?, then A, M A, = 2. 


The sets in # are called the blocks or cells of the partition. Figure 4.2 shows 
a partition P = {A,, Ay, A;, Ay, As, A, Az} of A into seven blocks. 


Example 6. Let 
A = {a, b,c, d,e, f, g, h}. 
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Figure 4.2 


Consider the following subsets of A: 
A, = {a, b,c, dj, A, = {a,c,e, f, 3, A}, A, = {a,c,e, gh, 


A, = {bd}, As = {fA}. 
Then {A,, A,} is not a partition since A; N A, # ©. Also, {A,, As} is not 


a partition since e & A, and e & As. The collection P = {A3, Ay, As} is a partition 
of A. Sd 


Example 7. Consider the set A of all employees of General Motors. If we form 
subsets of A by grouping in a subset all employees who make exactly the same 
salary, we obtain a partition of A. Each employee will belong to exactly one 
subset. Sd 


Example 8. Let 
Z = set of all integers, 
A, = set of all even integers, and 
A, = set of all odd integers. 


Then {A,, A)} is a partition of Z. Sd 
Since the members of a partition of a set A are subsets of A, we see that the 


partition is a subset of P(A). thie power set of A. That is, partitions can be con- 
sidered as particular kinds of subsets of P(A). 


EXERCISE SET 4.1 


. In each part, find x or y so that the statement is 
true. 

{a) (x, 3) = (4, 3) 

{b) (a, 3y) = (@,9) 

(c) (3x + 1,2) = (7,2) 

(d) (C~*, PASCAL) = (y, x) 


. In each part, find x or y so that the statement is 
true. 

(a) (4x, 6) = (16, y) 

(b) (2x ~ 3,3y — 1) = G,5) 

(c) (7,25) = (49,y) (d) (») = Gy”) 


. Let A = {a, b} and B = {4, 5, 6}. List the ele- 
ments in 

(a) AX B 
(c) AXA 


(b) BXA 
(d) BXB 


. Let A = {Fine, Yang} and B = {president, vice- 
president, secretary, treasurer}. Give each of the 
following. 
(a) AXB (b) BXA (c) AXA 
. A genetics experiment classifies fruit flies 
according to the following two criteria: 
Gender: male (m), female (f) 
Wing span: short (s), medium (m), long (J) 
(a) How many categories are there in this clas- 
sification scheme? 
(b) List all the categories in this classification 
scheme. 


. A car manufacturer makes three different types 
of car frames and two types of engines. 
Frame type: sedan (s), coupe (c), van (v) 
Engine type: gas (g), diesel (d) 
List all possible models of cars. 


. If A = {a,b,c}, B = {1,2}, and C = {#, +}, list all 
the elements of A X B X C. 


. If A has three elements and B has n = 1 ele- 
ments, use mathematical induction to prove 
that |A x B| = 3n. 


. If A = {a | ais a real number} and B = {1,2, 3}, 
sketch each of the following in the Cartesian 
plane. 


(a) AXB (b) BX A 


10. 


11. 


13. 


14. 


15. 


16. 
17. 


18. 


19, 


20. 
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If A = {a| ais a real number and —2 <a <3} 
and B = {b| bis areal number and1 = b <5}, 
sketch each of the following in the Cartesian 
plane. 

(a) AXB (b) BX A 

Show that if A, has n, elements, A, has 7, ele- 
ments, and A, has n; elements, then 

A, X A, X A; has n, + n, + n, elements. 


. If AC Cand B C D, prove that A X BC 


Cx D. 
Let A = {1, 2,3, 4,5, 6, 7, 8, 9, 10} and 
A, = (1,2,3,4}, Ay = (5, 6,7}, 
A; | {4, 5, 7, 9}, Ay ig (4, 8, 10}, 
As = [8,9, 10}, Ag = {1, 2,3, 6, 8, 10}. 


Which of the following are partitions of A? 
(a) {Aj,Ap, As} (b) {Ay, As, As} 
(c) {A3, Ag} (d) {A,, Az, Ag} 


If A, is the set of positive integers and A, is the 
set of all negative integers, is {A,,.A,} a parti- 
tion of Z? Explain your conclusion. 


If B = {0,3,6,9,...}, give a partition of B con- 
taining 

(a) two infinite subsets. 

(b) three infinite subsets. 


List all partitions of A = {1,2, 3}. 
List all partitions of B = {a, b,c, d}. 


The number of partitions of a set with n ele- 
ments into k subsets satisfies the recurrence 
relation 


S(n, k) = Sia ~1,k — 1) + k+ S(n - 1,k) 


with initial conditions S(m,1) = S(m,n) = 1. 
Find the number of partitions of a set with four 
elements into two subsets, that is, $(4, 2). 
Compare your result with the results of 
Exercise 17. 


Let A, B, and C be subsets of U. Prove that 
AX(BUC)= (AX B)U(AX C). 


Use the sets A = {1,2, 4}, B = {2,5, 7}, and C= 
{1, 3, 7} to investigate whether A X (BM C) = 
(A X B)N (A x C). Explain your conclusions. 
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4.2. Relations and Digraphs 


Relations 


The notion of a relation between two sets of objects is quite common and intu- 
itively clear (a formal definition will be given later). If A is the set of all living 
human males and B is the set of all living human females, then the relation F 
(father) can be defined between A and B. Thus, if x € A and y € B, then x is re- 
lated to y by the relation F if x is the father of y, and we write x F y. Because order 
matters here, we refer to F as a relation from A to B. We could also consider the 
relations § and H from A to B by letting x S y mean that x is a son of y, and 
x H y mean that x is the husband of y. 

If A is the set of all real numbers, there are many commonly used relations 
from A to A. An example is the relation “less than,” which is usually denoted by 
<,so that x is related to y if x <‘ y, and the other order relations >, =, and =. We 
see that a relation is often described verbally and may be denoted by a familiar 
name or symbol. The problem with this approach is that we will need to discuss 
any possible relation from one abstract set to another. Most of these relations 
have no simple verbal description and no familiar name or symbol to remind us 
of their nature or properties. Furthermore, it is usually awkward, and sometimes 
nearly impossible, to give any precise proofs of the properties that a relation sat- 
isfies if we must deal with a verbal description of it. 

To get around this problem, observe that the only thing that really matters 
about a relation is that we know precisely which elements in A are related to 
which elements in B. Thus suppose that A = {1, 2, 3, 4} and R is a relation from 
A to A. If we know that 1 R 2,1 R3,1R4,2 R3,2R 4,and 3 R 4, then we know 
everything we need to know about R. Actually, R is the familiar relation <, “less 
than,” but we need not know this. It would be enough to be given the foregoing 
list of related pairs. Thus we mav say that R is completely known if we know all 
R-related pairs. We could then write R = {(1, 2), (1,3), (1, 4), (2, 3), (2, 4), (3, 4)}, 
since R is essentially equal to or completely specified by this set of ordered pairs. 
Each ordered pair specifies that its first element is related to its second element, 
and all possible related pairs are assumed to be given, at least in principle. This 
method of specifying a relation does not require any special symbol or descrip- 
tion and so is suitable for any relation between any two sets. Note that from this 
point of view a relation from A <o B is simply a subset of A x B (giving the re- 
lated pairs), and, conversely, any subset of A X B can be considered a relation, 
even if it is an unfamiliar relation for which we have no name or alternative 
description. We choose this approach for defining relations. 

Let A and B be nonempty sets. A relation R from A to B is a subset of 
A xX B.IfR CA X Band (a,b) € R, we say that a is related to b by R, and we 
also write a R b. If a is not related to b by R, we write a RK b. Frequently, A and B 
are equal. In this case, we often say that RC A X A is a relation on A, instead of 
a relation from A to A. 

Relations are extremelv important in mathematics and its applications. It is 
not an exaggeration to say that 90 percent of what will be discussed in the 
remainder of this book will concern some type of object that may be considered 
a relation. We now give a number of examples. 
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Example 1. Let 
A = {1,2,3) and B= {r,s}. 
Then 
R= {(1,7), 2,5), B,} 


is a relation from A to B. ¢ 


Example 2. Let A and B be sets of real numbers. We define the following rela- 
tion R (equals) from A to B: 


aRb ifandonlyif a=b. 


Example 3. Let 
A = {1,2,3, 4, 5}. 
Define the following relation R (less than) on A: 
aRb ifandonlyif a<b. 
Then 
R = {(1, 2), (1, 3), (1, 4), (2,5), (2, 3), (2.4,2.5),3,4,6,59,(4 5}. 


Example 4. Let A = Z*, the set of all positive integers. Define the following 
relation R on A: 


aRb ifandonlyif a divides b. 
Then 4 R 12, but 5 R7. ° 


Example 5. Let A be the set of all people in the world. We define the following 


relation R on A:a R 6b if and only if there is a sequence dy, a,,..., a, of people 
such that a, = a, a, = b and a;_, knows a,,i = 1,2,...,n (n will depend on a 
and b), Sd 


Example 6. Let A = R, the set of all real numbers. We define the following rela- 
tion R on A: 
; : sO ate ary 
xRy ifandonlyif x and y satisfy the equation 4 + 7a 1. 


The set R consists of all points on the ellipse shown in Figure 4.3. a 


Example 7. Let A be the set of all possible inputs to a given computer program, 
and let B be the set of all possible outputs from the same program. Define the 
following relation R from A to B:a R b if and only if b is the output produced 
by the program when input a is used. o 
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Figure 4.3 
Example 8. Let 
A = the set of all lines in the plane. 
Define the following relation R on A: 
1,R1, ifandonlyif J, is parallel to 1, 
where /, and J, are lines in the plane. ° 


Example 9. An airline services the five cities c,, C), ¢, cy, and c;. Table 4.1 gives 


the cost (in dollars) of going from c; to c;. Thus the cost of going from c, to ¢; is 
$100, while the cost of going from c, to c, is $200. 


Table 4.1 
To 

From C C3 on Cs 
cy 140 100 150 200 
cy 200 160 220 
C5 180 190 250 
Cy 200 120 150 


cs 100 200 150 
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We now define the following relation R on the set of cities A = {c,, €), C3, C4, C5}: 
c,Rc, ifand only if the cost of going from c; to c, is less than or equal to $180. 
Find R. 


Solution: The relation R is the subset of A X A consisting of all cities 
(c;, ¢;), where the cost of going from c; to c; is less than or equal to $180. 
Hence 


R= 
{(€1, Cz). (Cys €3)s (Cys C4)s (Co, C4)s (Cay €y)s (C5, Ca) 5 (Cas €3)s (Cas C5), (C5 Ca), (C5 Ca) }. 


Sets Arising from Relations 


Let RCA X B bea relation from A to B. We now define various important and 
useful sets related to R. 

The domain of R, denoted by Dom(R), is the set of elements in A that are 
related to some element in B. In other words, Dom(R), a subset of A, is the set of 
all first elements in the pairs that make up R. Similarly, we define the range of R, 
denoted by Ran(R), to be the set of elements in B that are second elements of 
pairs in R, that is, all elements in B that are related to some element in A. 

Elements of A that are not in Dom(R) are not involved in the relation R in 
any way. This is also true for elements of B that are not in Ran(R). 


Example 10. If R is the relation defined in Example 1, then Dom(R) = A and 
Ran(R) = B Sd 


Example 11. If Ris the relation given in Example 3, then Dom(R) = {1, 2,3, 4} 
and Ran(R) = {2, 3, 4, 5}. cd 


Example 12. Let R be the relation of Example 6. Then Dom(R) = [—2, 2] and 
Ran(R) = [—3, 3]. Note that these sets are given in interval notation. ° 


If R is a relation from A to B and x € A, we define R(x), the R-relative set 
of x, to be the set of all y in B with the property that x is R-related to y. Thus, in 
symbols, 


R(x) ={y © Bl x Ry}. 


Similarly, if A, C A, then R(A,), the R-relative set of Aj, is the set of all y in B 
with the property that x is R-related to y for some x in A,. That is, 


R(A,) = {y € B|x Ry for some x in Aj}. 


From the preceding definitions, we see that R(A)) is the union of the sets R(x), 
where x © A,. The sets R(x) play an important role in the study of many types of 
relations. 


Example 13. Let A = {a,b, c,d} and let R = {(a,a), (a,b), (0, ©), (ec, 4), (4,0), (e, ye 
Then R(a) = {a, b}, R(b) = {c}, and if A, = {c, d}, then R(A,) = {a, b, ch. 


Example 14. Let R be the relation of Example 6, and let x € R. If x R y for some 
y, then x7/4 + y?/9 = 1. We see that if x is not in the interval (—2, 2), then no y can 
satisfy the equation above, since x°/4 > 1. Thus, in this case, R(x) = 
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If x = —2, then x7/4 = 1, so x can only be related to 0. Thus R(—2) = {0}. 
Similarly, R(2) = {0}. Finally, if -2 <x < 2 and x R y, then we must have 
y = V9 — (9x7/4) or y = V9 — (9x7/4), as we see by solving the equation 
x74 + y/9 = 1, so that R(x) = [V9 — (9x7/4), —V9 — (9x7/4)}. Thus, for 
example, R(1) = {(3V3)/2, ~(8V3)/2}. + 


The following theorem shows the behavior of the R-relative sets with 
regard to basic set operations. 


Theorem 1. Let R be the relation from A to B, and let A, and A, be subsets of A. 
Then 

(a) If A, C A), then R(A,) C R(A,). 

(b) R(A, U A,) = R(A,) U R(A)). 

(c) R(A, M A,) C R(A,) C R(A)). 


Proof: (a) If y © R(A,), then x R y for some x € Aj. Since A; © A), 
x € A,. Thus, y © R(A,), which proves part (a). 

(b) If y € R(A, U A,), then by definition x R y for some x in A, U A. If 
xis in A,, then, since x R y, we must have y € R(A,). By the same argument, 
if x is in A,, then y € R(A,). In either case, y © R(A,) U R(A,). Thus we 
have shown that R(A, U A;) € R(A,) U R(A,). 

Conversely, since A, 2 (A, U A,), part (a) tells us that R(A,) C 
R(A, U A,). Similarly. R(A,) C R(A, U A,). Thus R(A,) U R(A,) C 
R(A, U A,), and therefore part (b) is true. 

(c) If y © R(A, N A,), then, for some x in A, N Aj, x R y. Since x is in 
both A, and A,, it follows that y is in both R(A,) and R(A,); that is, y © 
R(A,) 1 R(A,). Thus part (c) holds. Ca 


Notice that Theorem 1(c) does not claim equality of sets. See Exercise 16 
for conditions under which the two sets are equal. In the following example, we 
will see that equality does not always hold. 


Example 15. Let A = Z, R be “=,” A, = (0,1, 2}, and A, = {9, 13}. Then R(A,) 
consists of all integers n such that 0 = n, or 1 =n, or 2 =n. Thus R(A,) = {0,1, 
2,...}. Similarly, R(A,) = {9, 10. 21,...},so0 R(A,) MN R(A,) = (9,10, 11,...}.On 
the other hand, A; N A, = ©; thus R(A, M A,) = SO. This shows that the con- 
tainment in Theorem 1(c) is not always an equality. Sd 


Example 16. Let A = {1,2,3} and B = {x, y, z, w, p,q}, and consider the relation 
R = ((1,x), (1, z), (2, ), (2,p), (2.4), (3,y))- Let A, = {1,2} and A, = {2,3}. Then 
R(A,) = {x, z, w, p, gq} and R(A,) = {w, p, gq, y}. Thus R(A,) U R(A,) = B. Since 
A, U A, = A, we see that R(A, UU A,) = R(A) = B, as stated in Theorem 1(b). 
Also, R(A,) N R(A,) = {w, p, q} = R({2}) = R(A, M A,), so in this case equality 
does hold for the containment in Theorem 1(c). Sd 


It is a useful and easily seen fact that the sets R(a), for a in A, completely 
determine a relation R. We state this fact precisely in the following theorem. 
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Theorem 2. Let R and S be relations from A to B. If R(a) = S(a) for alla in A, 
then R= S. 


Proof: IfaRb,then bd € R(a). Therefore, b € S(a) anda S$ b. A completely 
similar argument shows that, if a S b, then a R b. Thus R = S. 


The Matrix of a Relation 


We can represent a relation between two finite sets with a matrix as follows. If 
A = {a,,4,,...,a,} and B = {b,,b,,...,5,} are finite sets containing m and n 
elements, respectively, and R is a relation from A to B, we represent R by the 
m X a matrix Mz = [m,], which is defined by 


_|1 if@.b) ER 
¥~10 if (a,b) ER. 


The matrix Mg is called the matrix of KR. Often M, provides an easy way to check 
whether R has a given property. 


m 


Example 17. Let R be the relation defined in Example 1. Then the matrix of 
Ris 
1 0 
M,=]0 1]. 
1 0 o 
Conversely, given sets A and B with |A| = m and |B| =n, an m X n matrix 


whose entries are zeros and ones determines a relation, as is illustrated in the fol- 
lowing example. 


Example 18. Consider the matrix 
100 1 
M=/0 1 1 OJ}. 
1 01 0 
Since M is 3 X 4, we let 
A = {a,,4,4;} and B = {b,, by, by, b,}. 


Then (a, 5,) € R if and only if m,; = 1. Thus 
R= {(a,, D1), (@1, Ba)> (4, Ba), (a, bs), (43, 1), (4s Bs)}- * 


Digraphs 


If A is a finite set and R is a relation on A, we can also represent R pictorially as 
follows. Draw a small circle for each element of A and label the circle with the 
corresponding element of A. These circles are called vertices. Draw an arrow, 
called an edge, from vertex a; to vertex a, if and only if a; R a; The resulting pic- 
torial representation of R is called a directcd graph or digraph of R. 
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Thus, if R is a relation on A, the edges in the digraph of R correspond ex- 
actly to the pairs in R, and the vertices correspond exactly to the elements of the 
set A. Sometimes, when we want to emphasize the geometric nature of some 
property of R, we may refer to the pairs of R themselves as edges and the ele- 
ments of A as vertices. 


Example 19. Let 


A = {1,2,3, 4} 
R = {(1, 1), (1, 2), (2, 1), (2, 2), (2, 3), (2, 4), (3, 4), (4 DI. 
Then the digraph of R is as shown in Figure 4.4. ° 


Figure 4.4 


A collection of vertices with edges between some of the vertices determines 
a relation in a natural manner. 


Example 20. Find the relation determined by Figure 4.5. 


Figure 4.5 
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Solution: Since a; R a; if and only if there is an edge from a; to a,, we have 
R= ((1, 1), 0, 3), 2, 3), GB. 2), B, 3), (4,3)}- . 


In this book, digraphs are nothing but geometrical representations of rela- 
tions, and any statement made about a digraph is actually a statement about the 
corresponding relation. This is especially important for theorems and their 
proofs. In some cases, it is easier or clearer to state a result in graphical terms, but 
a proof will always refer to the underlying relation. The reader should be aware 
that some authors allow more general objects as digraphs, for example, by per- 
mitting several edges between the same vertices. 

An important concept for relations is inspired by the visual form of di- 
graphs. If R is a relation on a set A and a € A, then the in-degree of a (relative 
to the relation R) is the number of b € A such that (b, a) € R. The out-degree of 
a is the number of b € A such that (a, b) E R. 

What this means, in terms of the digraph of R, is that the in-degree of a ver- 
tex is the number of edges terminating at the vertex. The out-degree of a vertex 
is the number of edges leaving the vertex. Note that the out-degree of a is |R(a)j. 


Example 21. Consider the digraph of Figure 4.4. Vertex 1 has in-degree 3 and 
out-degree 2. Also consider the digraph shown in Figure 4.5. Vertex 3 has in- 
degree 4 and out-degree 2, while vertex 4 has in-degree 0 and out-degree1. # 


Example 22. Let A = {a, b,c, d}, and let R be the relation on A that has the 
matrix 


My, = 


oOror 
PrrRO 
oOroeo:e 
Poo © 


Construct the digraph of R, and list in-degrees and out-degrees of all 
vertices. 


Solution: The digraph of R is shown in Figure 4.6. The following table gives 
the in-degrees and out-degrees of all vertices. 


In-degree 


Out-degree 
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Example 23. Let A = {1,4,5}, and let R be given by the digraph shown in Figure 
4.7. Find Mz and R. 


Figure 4.6 


a= 


‘. 
Figure 4.7 
Solution 
041 1 
Meg=]1 1 OO}, R=(0.49.0,5.4D),49,6.9,6, 5). 
041i 


If R is a relation on a set A, and B is a subset of A, the restriction of R to B 
is RM (BX B). 


Example 24. Let A = {a,b,c,d,e,f} and R = {(a, a), (a,c), (b,c), (a, e), 
(b, e), (c, e)}. 
Let B = {a, b, c}. Then 


BX B= {(a, 4), (a, 5), (a, °), (b, a), (b, b), (8, c), (c, a), (c, B), (c, ©} 
and the restriction of R to B is {(a, a), (a,c), (b, c)}. ° 


EXERCISE SET 4.2 


1. (a) For the relation R defined in Example 4, 
which of the following ordered pairs belong 
to R? 
@ (2,3) Gli) (0,8) (iii) (1, 3) 
(iv) (6,18) (v) (-6,24) (vi) (8,0) 
(b) For the relation R defined in Example 6, 
which of the following ordered pairs belong 
to R? 
(i) (2,0) ii) (0,2) Gai)- (0,3) 
(iv) (0,0)  (v) (1,3/2V3) (vi) (0,0) 


In Exercises 2 through 10, find the domain, 
range, matrix, and, when A = B, the digraph of 
the relation R. 


2. A = {a,b, c,d}, B = {1,2,3}, R = {(a, 1), (a,2), 
(b, 1), (¢, 2), (d, 1} 


3. A = {IBM, COMPAQ, Dell, Gateway, Zenith}, 
B = {750C, PS60, 450SV, 4/33S, 525SX, 
466V, 486SL} 
R = {(IBM, 750C), (Dell, 466V), 
(COMPAQ, 450SV), (Gateway, PS60)} 


4, A={1,2,3,4), B= (1,4,6,8, 9k: @ R dif and 
only if b = a’. 


§. A = {1,2,3,4,8} = By a R b if and only if a = b. 


6. A = {1,2, 3,4, 8}, B = {1, 4, 6, 9}: a R b if and 
only if a| b. 


7. A = {1,2,3,4, 6} = Bsa R b if and only if aisa 
multiple of b. 


8. A = {1, 2,3, 4,5} = Ba R b if and only ifa = b. 


9. A = (1,3,5,7,9}, B = (2,4,6, 8);a R bif and 
only if b <a. 


10. A = (1, 2,3, 4,8} = B;a R b if and only if 
a+b<9, 


11. Let A = Z*, the positive integers, and R be the 
relation defined by a R b if and only if there 
exists a k in Z* so that a = b*(k depends ona 
and 5). Which of the following belong to R? 
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(c) (8,2) 
(f) (2,32) 


(a) (4, 16) 
(d) 3,3) 


(b) (4,7) 
(e) @,8) 


12. Let A = R. Consider the following relation R 
on A;a R b if and only if 2a + 3b = 6. Find 
Dom(R) and Ran(R). 


13. Let A = R. Consider the following relation R 
on A;a R b if and only if a? + b? = 25. Find 
Dom(R) and Ran(R). 


14. Let R be the relation defined in Example 6. 
Find R(A,) for each of the following. 
(a) A, = {1,8} (6) Ay = (3,4,5} © A, =f} 


15. Let R be the relation defined in Exercise 7. 
Find each of the following. 
(a) RB) (b) RG) (c) R({2, 4, 6}) 


16. Let R be a relation from A to B. Prove that for 
all subsets A, and A, of A 
R(A, 0 Ay) = R(Ay) N R(A,) _ if and only if 
R(a) MN R(b) = { } for any distinct a, b in A. 
17. Let A = R. Give a description of the relation R 
specified by the shaded region in Figure 4.8. 
y 


(0, 2) (3, 2) 


3,0) 
Figure 4.8 


18. If.A has n elements and B has m elements, how 
many different relations are there from A to B? 
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In Exercises 19 and 20, give the relation R 
defined on A and its digraph. 


19. Let A = (1,2,3,4} and M, = 


PF oOo F 
oor FM 
orroc 
o,ror 


20. Let A = {a, b,c, d, e} 


Figure 4.10 


and M, = 


23. (a) For the digraph in Exercise 21, give the in- 
degree and the out-degree of each vertex. 
(b) For the digraph in Exercise 22, give the in- 
In Exercises 21 and 22, find the relation deter- degree and the out-degree of each vertex. 
mined by the digraph and give its matrix. 


Poo OF 
oOroo 
or Oro 
oorr & 
ooroe 


24. Let A = (1,2, 3,4, 5,6, 7) and R = (1,2), (1,4), 
21. (2, 3), (2, 5), (3, 6), (4, 7)}. Compute the restric- 
tion of R to B for the subset of A given. 
(a) B = (1,2,4,5} 
(b) B = (2,3,4,6} 


25. Let $ be the product set (1, 2,3} x (a, b}. How 
many relations are there on S? 


Figure 4.9 


4.3. Paths in Relations and Digraphs 


Suppose that R is a relation on a set A. A path of length n in R from a to bisa 
finite sequence 7: a, X,,X2,...,2,_,,, beginning with a and ending with b, such 
that 


AR X,.x% Rx... ,%,-1 RO. 
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Note that a path of length n involves n + 1 elements of A, although they are not 
necessarily distinct. 

A path is most easily visualized with the aid of the digraph of the relation. 
It appears as a geometric path or succession of edges in such a digraph, where the 
indicated directions of the edges are followed, and in fact a path derives its name 
from this representation. Thus the length of a path is the number of edges in the 
path, where the vertices need not all be distinct. 


Example 1. Consider the digraph in Figure 4.11. Then a, :1,2,5, 4,3 is a path 
of length 4 from vertex 1 to vertex 3, 7,:1,2,5, 1 is a path of length 3 from ver- 
tex 1 to itself, and 7, : 2,2 is a path of length 1 from vertex 2 to itself. Sa 


Figure 4,11 


A path that begins and ends at the same vertex is called a cycle. In Example 
1, 7, and 7, are cycles of length 3 and 1, respectively. It is clear that the paths of 
length 1 can be identified with the ordered pairs (x, y) that belong to R. Paths in 
a relation R can be used to define new relations that are quite useful. If n is a 
fixed positive integer, we define a relation R” on A as follows: x R” y means that 
there is a path of length n from x to y in R. We may also define a relation R® on 
A, by letting x R” y mean that there is some path in R from x to y. The length of 
such a path will depend, in general, on x and y. The relation R® is sometimes 
called the connectivity relation for R. 

Note that R”(x) consists of all vertices that can be reached from x by means 
of a path in R of length n. The set R”(x) consists of all vertices that can be reached 
from x by some path in R. 


Example 2. Let A be the set of all living human beings, and let R be the relation 
of mutual acquaintance. That is, aq R b means that a and b know one another. Then 
a R? b means that a and b have an acquaintance in common. In general, 
a R" b if a knows someone x,, who knows x,,..., who knows x,_,, who knows b. 
Finally, a R” b means that some chain of acquaintances exists that begins at a and 
ends at b. It is interesting (and unknown) whether every two Americans, say, are 
related by R®. 5 


Example 3. Let A be a set of US. cities, and let x R y if there is a direct flight 
from x to y on at least one airline. Then x and y are related by R” if one can book 
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a flight from x to y having exactly n — 1 intermediate stops, and x R® » if one can 
get from x to y by plane. Sa 


Example 4. Let A = {1, 2. 3, 4, 5, 6}. Let R be the relation whose digraph is 
shown in Figure 4.12. Figure 4.13 shows the digraph of the relation R? on A. 
A line connects two vertices in Figure. 4.13 if and only if they are R?-related, that 
is, if and only if there is a path of length two connecting those vertices in Figure 
4.12. Thus 


1R°2 since 1R2 and 2R2 
1R?4 since 1R2 and 2R4 
1R°5 since 1R2 and 2R5 
2R?2 since 2R2 and 2R2 
2R°4 since 2R2 and 2R4 
2R°5 since 2R2 and 2R5 
2R’6 since 2R5 and 5R6 
3R?5 since 3R4 and 4R5 
4R°6 since 4R5 and 5R6. 


Tn a similar way, we can construct the digraph of R” for any n. Sd 


Figure 4.12 


Example 5. Let A = {a,b,c,d,e} and 
R = {(a, a), (a, E), (b,c), (e, e), (c, d), (d, e)}. 
Compute (a) R*; (b) R®. 
Solution: (a) The digraph of R is shown in Figure 4.14. 


aR’a since aRa and aRa 
aR’b since aRa and aRb 
aR’c since aRb and bRce 
bRe since bRce and cRe 

bR’d since bRe and cRd 
cR’e since cRd and dRe. 


Sec. 4.3. Paths in Relations and Digraphs 119 


Figure 4.13 


Figure 4.14 


Hence 
R* = {(a, a), (a, b), (a, c), (b, e), (b, d), (c, e)}. 


(b) To compute R®, we need all ordered pairs of vertices for which there 
is a path of any length from the first vertex to the second. From Figure 4.14 
we see that 


R= 
{(a, a), (a, 5), (a,c), (a, 4), (a, e), (b,c), (B, d), (b, €), (c, d), (c, €), (d, e)}- 
For example, (a, d) € R”, since there is a path of length 3 from a to d: a, b, 


c, d, Similarly, (a, e) € R®, since there is a path of length 3 from a to e: a, b, 
c, e as well as a path of length 4 from a to e: a, b,c, d, e. Ad 


120 = Chapter4 —_—Relations and Digraphs 


Let R be a relation cn a finite set A = {a,,a,,...,a,}, and let Mp be 
the n X n matrix representing R. We will show how the matrix Mp», of R’, 
can be computed from Mp. 


Theorem 1. /f R is a relation on A = (a,,4@,...,a,), then My = Mp © Mg (see 
Section 1.5). 


Proof: Let Mz = [m,] and Mj = [n,]. By definition, the i, jth element of 
Mg © Mg is equal to 1 if and only if row i of Mz and column j of Mg have 
a 1in the same relative position, say position k. This means that m, = 1 and 
m,; = 1 for some k, 1 <= k <= n. By definition of the matrix Ma, the condi- 
tions above mean that a, R a, and a, R a, Thus a; R a, and so n,; = 1. We 
have therefore shown that position i, j of Mz © Mg is equal to 1 if and only 
if n,, = 1.This means that Mz © Mz = Mp. Sd 


For brevity, we will usually denote Mg © Mg simply as (Mz)3 (the symbol 
© reminds us that this is not the usual matrix product). 


Example 6. Let A and R be as in Example 5.Then 


110 0 0 
001 0 0 
Mp={9 0 0 1 14. 
000041 
000 0 0 
From the preceding discussion, we see that 
i 10 0 0 1 10 00 
001 0 0 0010 0 
My =MrpOMp={9 0 0 1 14010 00 1 1 
0000 1 000041 
000 0 0 0600 0 0 
11100 
0001 ii 
={0 0 0 0 If. 
0 0 0 0 0 
0 60 00 0 
Computing M,: directly from R’, we obtain the same result. Cd 


We can see from Examples 5 and 6 that it is often easier to compute R? by 
computing Mp © Mz, instead of searching the digraph of R for all vertices that 
can be joined by a path of length 2. Similarly, we can show that Mz = 
My, © (Mz © M,) = (M,)@. In fact, we now show by induction that these two 
results can be generalized. 


Theorem 2. For n = 2 and Ra relation on a finite set A, we have 


Man = MeO Mp ©::: OMe (n factors). 
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Proof: Let P(n) be the assertion that the statement above holds for an inte- 
gern = 2. 


Basis STEP. P(2) is true by Theorem 1. 


INDUCTION STEP, We now show that if P(x) is true, then P(&k + 1) is true. 
Consider the matrix Myr ~1. Let Mge+1 = [x,], Myx = [y,], and My = [my]. 
If x, = 1, we must have a path of length k + 1 from a; to a, If we let a, 
be the vertex that this path reaches just before the last vertex a;, then 
there is a path of length & from 4a; to a, and a path of length 1 from a, to 
a, Thus y,, = 1 and m,, = 1,s0 Max © Mg has a 1 in position i, j. We can 
see, similarly, that if Myx © Mg has a 1 in position i, j, then x, = 1. This 
means that Mpk+1 = Myx © Ma. 

By induction, 


P(k): Mage = Mp ©+--O My, (Kk factors). 
so, by substitution, 
M,é+1 = (Mz © +>: O Mz) © Mg. 
P(k + 1):Mpe+1 = MpO°s-OM,OMa, (kK + 1 factors) 


and P(k + 1) is true. Thus, by the principle of mathematical induction, 
P(n) is true for all n = 2. This proves the theorem. As before, we write 
Mz © -+: © Mg (n factors) as (Mx). o 


Now that we know how to compute the matrix of the relation R” from the 
matrix of R, we would like to see how to compute the matrix of R®. We proceed 
as follows. Suppose that R is a relation on a finite set A, and x € A, y € A. We 
know that x R® y means that x and y are connected by a path in R of length n for 
some n. In general, n will depend on x and y, but, clearly, x R® y if and only if 
xRyorx R’ yorx Ry or.... lf Rand S are relations on A, the relation R U S$ 
is defined by x (R U S) y if and only if x R y or x S y. (The relation R U S will be 
discussed in more detail in Section 4.7.) Thus the statement above tells us that 
R®=RURU R8U--:= U2_, R".The reader may verify that Mays = Mz VV Mg, 
and we will show this in Section 4.7. Thus 


My = Me VM VM V °° 
= MeV (Mg) V (MSV 


The reachability relation R* of a relation R on a set A that has » elements 
is defined as follows: x R* y means that x = y or x R” y. The idea is that y is reach- 
able from x if either y is x or there is some path from x to y. It is easily seen that 
M, = Mp: \ I, where I, is the n X n identity matrix. Thus our discussion shows 
that 


Mg: = 1, Ma) (Ma) V (Mga Vo 


Let a 24, x4, %5,...,%X,-1, 0 be a path in a relation R of length n from a to 
b, and let a:b, y), 2,--+,¥m—p € be a path in R of length m from b to c. Then the 
composition of 7, and 7, is the path a, x,,%),...,2, Ys Yo ++++¥m—v © Of length 


n + m, which is denoted by 7, ¢ 7. This is a path from a to c. 
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Example 7. Consider the relation whose digraph is given in Figure 4.15 and the 
paths 


mi4.2,3 and 7,:3,5,6,2,4. 


Figure 4.15 


Then the composition of 7, and ‘7, is the path a, ° 7, :1,2,3,5,6,2,4 from 1 to 
4 of length 6. o 


EXERCISE SET 4.3 


For Exercises 1 through 8, let R be the relation 
whose digraph is given in Figure 4.16. 


1. List all paths of length 1. 
2. (a) List all paths of length 2 starting from 


vertex 2. 
(b) List all paths of length 2. 


3. (a) List all paths of length 3 starting from 
vertex 3. 
(b) List all paths of length 3. 


4. Find a cycle starting at vertex 2. 


5. Find a cycle starting at vertex 6. Figure 4.16 


6. Draw the digraph of R’. 
7. Find M;. 


8 (a) Find R®. 
(b) Find M,. 


For Exercises 9 through 15, let R be the relation 
whose digraph is given in Figure 4.17. 


9. List all paths of length 1. 


10. (a) List all paths of length 2 starting from 
vertex c. 
(b) Find all paths of length 2. 


11. (a) List all paths of length 3 starting from 
vertex a. 
(b) Find all paths of length 3. 


12. (a) Find a cycle starting at vertex c. 
(b) Find a cycle starting at vertex d. 


13. Draw the digraph of R?. 


14. Find Mz. 
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15. (a) Find Me. 
(b) Find R®. 


16. Let R and S be relations on a set A. Show that 
Mrus = MeV Ms. 


17. Let R be a relation on a set A that has n ele- 
ments. Show that M;* = Mg \/ I,, where I, is 
the n X n identity matrix. 


In Exercises 18 and 19, let R be the relation 
whose digraph is given in Figure 4.18. 


18. If 7, :1,2,4,3 and 7, :3, 5, 6, 4, find the compo- 
sition 70 7. 


19. If 7,:1,7,5 and a, :5, 6,7, 4, 3, find the compo- 
sition 7, 0 7. 


20. Let A = [1,2,3,4,5} and 2 be the relation 
defined by a R b if and only if a < b. 
(a) Compute R? and R’. 
(b) Complete the following statement: a R? b if 
and only if : 
(c) Complete the following statement: a R* b if 
and only if : 


Figure 4.17 


Figure 4,18 
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4.4. Properties of Relations 


In many applications to computer science and applied mathematics, we deal with 
relations on a set A rather than relations from A to B. Moreover, these relations 
often satisfy certain properties that will be discussed in this section. 


Reflexive and Irreflexive Relations 


A relation R on a set A is reflexive if (a,a) € R for all a € A, that is, if a R a for 
alla € A.A relation R on a set A is irreflexive if a Ra for every a € A. 

Thus R is reflexive if every element a € A is related to itself and it is 
irreflexive if no element is related to itself. 


Example 1 

(a) Let A = {(a,a)| a € A}, so that A is the relation of equality on the set A. Then 
A is reflexive, since (a,a) € A for alla € A. 

(b) Let R = {(a,b) € A X A| a # bd}, so that R is the relation of inequality on the 
set A. Then R is irreflexive, since (a,a) € R for alla € A. 

(c) Let A = {1, 2, 3}, and let R = {(1, 1), (1, 2)}. Then R is not reflexive since 
(2,2) € R and (3,3) ¢ R. Also, R is not irreflexive, since (1,1) € R. 

(d) Let A be a nonempty set. Let R = @ C A X A, the empty relation. Then R is 
not reflexive, since (a, a) ¢ R for alla € A (the empty set has no elements). 
However, R is irreflexive. Sd 


We can identify a reflexive or irreflexive relation by its matrix as follows. 
The matrix of a reflexive relation must have all 1’s on its main diagonal, while the 
matrix of an irreflexive relation must have all 0’s on its main diagonal. 

Similarly, we can characterize the digraph of a reflexive or irreflexive rela- 
tion as follows. A reflexive relaticn has a cycle of length 1 at every vertex, while 
an irreflexive relation has no cycles of length 1. Another useful way of saying the 
same thing uses the equality relation A on a set A: R is reflexive if and only if 
AC R, and R is irreflexive if and only if AN R = ©. 

Finally, we may note that if R is reflexive on a set A, then Dom(R) = 
Ran(R) = A. 


Symmetric, Asymmetric, and Antisymmetric 
Relations 


A relation R on a set A is symmetric if whenever a R b, then b Ra. It then follows 
that R is not symmetric if we have some a and b € A witha R 5, but b Ra.A rela- 
tion R on a set A is asymmetric if whenever a R b, then b Ra. It then follows that 
R is not asymmetric if we have some a and b € A with botha Rb and b Ra, 

A relation R on a set A is antisymmetric if whenever a R b and b R a, then 
a = b. The contrapositive of this definition is that R is antisymmetric if whenever 
a # b,thena Rb or b Ra. It follows that R is not antisymmetric if we have a and 
bin A,a # b,and botha R band ob Ra. 

Given a relation R, we shall want to determine which properties hold for R. 
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Keep in mind the following remark. A property fails to hold in general if we can 
find one situation where the property does not hold. 


Example 2. Let A = Z, the set of integers, and let 
R={(a,b)EAXAla<b} 
so that R is the relation less than. Is R symmetric, asymmetric, or antisymmetric? 


Solution 
Symmetry: Tf a< 6, then it is not true that b < a, so R is not symmetric. 


Asymmetry: Ifa < b, then b < a (0 is not less than a), so R is asym- 


metric. 
Antisymmetry: If a # b, then either a « b or b < a, so that R is 
antisymmetric. oa 


Example 3. Let A be a set of people and let 
R = [(x,y) € A X A |x is a cousin of y}. 


Then R is a symmetric relation (verify). o 
Example 4. Let A = {1, 2,3, 4} and let 


R = {(1, 2), (2,2), (3, 4), (4, 1}. 


Then R is not symmetric, since (1,2) € R, but (2,1) ¢ R. Also, R is not asym- 
metric, since (2,2) € R. Finally, R is antisymmetric, since if a # b, either (a,b) ¢ R 
or (b,a) € R. Sd 


Example 5. Let A = Z*, the set of positive integers, and let 
R={(a,b)€ A X A|a divides b}. 
Is R symmetric, asymmetric, or antisymmetric? 


Solution 
If a | b, it does not follow that 6 | a, so R is not symmetric. For 
example, 2 | 3, but 3f 2. 
Ifa = b = 3, say, thena R b and b Ra, so R is not asymmetric. 
Ifa | band b| a, then a = b, so R is antisymmetric, (See Exercise 24 in 
Section 1.4.) ¢ 


We now relate symmetric, asymmetric, or antisymmetric properties of a 
relation to properties of its matrix. The matrix Mz = [m,] of a symmetric relation 
satisfies the property that 

if m,;=1, then m,=1. 
Moreover, if m, = 0, then m, = 0. Thus Mg is a matrix such that each pair of 
entries, symmetrically placed about the main diagonal, are either both 0 or both 
1. It follows that Mz = Mj, so that Mg is a symmetric matrix (see Section 1.5). 

The matrix M, = [m,] of an asymmetric relation R satisfies the property 
that 

if m;=1, then m,=0. 


i= 
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If R is asymmetric, it follows that mm,, = 0 for all i; that is, the main diagonal of the 
matrix M, consists entirely of 0’s, This must be true since the asymmetric prop- 
erty implies that if m,, = 1, then m,, = 0, which is a contradiction. 

Finally, the matrix M, = [m,] of an antisymmetric relation R satisfies the 
property that if i # j, then m,, == 0 or m,; = 0. 


Example 6. Consider the matrices in Figure 4.19, each of which is the matrix of 
a relation, as indicated. 

Relations RX, and R, are syrametric since the matrices Mp, and Mp, are sym- 
metric matrices. Relation R, is antisymmetric, since no symmetrically situated, 
off-diagonal positions of M,, both contain 1’s. Such positions may both have 0s, 
however, and the diagonal elements are unrestricted. The relation R, is not asym- 
metric because M,,, has 1’s on the main diagonal. 

Relation R, has none of the three properties: Mz, is not symmetric. The 
presence of the 1 in position 4. | of Mg, violates both asymmetry and antisym- 
metry. 

Finally, R, is antisymmetric but not asymmetric, and R, is both asymmetric 


and antisymmetric. 6d 
0110 
101 
1100 
Os at a torial ™ 
io a. 
ae Hs vi 
(a) (b) 
ied 
Pho 
@5:0) 20 
0 1 0 |= Mk, ee ee Mey 
00 0 
1: 080 
(c) (@) 
1s, Otis 3 O i> a 
(eae a | ‘ aa 7 8 - 
‘ oS R 
0010 = 0001 : 
0001 00 0 0 
(e) (f) 


Figure 4,19 
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We now consider the digraphs of these three types of relations. If R is an 
asymmetric relation, then the digraph of R cannot simultaneously have an edge 
from vertex i to vertex j and an edge from vertex j to vertex i. This is true for any 
i and j, and in particular if i equals j. Thus there can be no cycles of length 1, and 
all edges are “one-way streets,” 

If R is an antisymmetric relation, then for different vertices i and j there 
cannot be an edge from vertex i to vertex j and an edge from vertex / to vertex i. 
When i = j, no condition is imposed. Thus there may be cycles of length 1, but 
again all edges are “one way.” 

We consider the digraphs of symmetric relations in more detail. 

The digraph of a symmetric relation R has the property that if there is an 
edge from vertex i to vertex j, then there is an edge from vertex / to vertex i. Thus, 
if two vertices are connected by an edge, they must always be connected in both 
directions. Because of this, it is possible and quite useful to give a different rep- 
resentation of a symmetric relation. We keep the vertices as they appear in the 
digraph, but if two vertices a and b are connected by edges in each direction, we 
replace these two edges with one undirected edge, or a “two-way street.” This 
undirected edge is just a single line without arrows and connects a and b. The 
resulting diagram will be called the graph of the symmetric relation. (Graph will 
be given a more general meaning in Chapter 6.) 


Example 7. Let A = {a, b,c, d, e} and let R be the symmetric relation given by 


R = ((a,6), (6, a), (a,c), (ca), (6, ¢), (c, 5), 
(b, e), (e, b), (e, d), (d, e), (c, d), (d,c)}. 
The usual digraph of R is shown in Figure 4,.20(a), while Figure 4.20(b) shows the 
graph of R. Note that each undirected edge corresponds to two ordered pairs in 
the relation R. od 


An undirected edge between a and 5b, in the graph of a symmetric relation 
R, corresponds to a set {a, b} such that (a, b) © R and (b, a) € R. Sometimes we 
will also refer to such a set {a, b} as an undirected edge of the relation R and call 
a and b adjacent vertices. 

A symmetric relation R on a set A will be called connected if there is a path 
from any element of A to any other element of A. This simply means that the 


Digraph of R Graph of R 
(a) (b) 


Figure 4.20 
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graph of R is all in one piece. In Figure 4.21 we show the graphs of two symmet- 
ric relations. The graph in Figure 4.21(a) is connected, whereas that in Figure 
4.21(b) is not connected. ¢ 


‘ 
©) ) 
: 


(a) (b) 


Figure 4.21 


Transitive Relations 


We say that a relation R on a set A is transitive if whenever a R b and b Rc, then 
a Rc. It is often convenient to say what it means for a relation to be not transi- 
tive. A relation R on A is not transitive if there exist a,b, and cin A so thata Rb 
and b Rc, but a Re. If such a, b, and c do not exist, then R is transitive. 


Example 8. Let A = Z, the set of integers, and let R be the relation considered 
in Example 2. To see whether R is transitive, we assume that a R b and b Rc. Thus 
a<bandb <c.It then follows that a <c,soa Rc. Hence R is transitive. 4 


Example 9. Let A = Z* and let R be the relation considered in Example 5. Is 
R transitive? 


Solution: Suppose that a & b and b Rc,so that a |b and 5 | c. It then does 
follow that a | c. [See Thecrem 2(d) of Section 1.4.] Thus R is transitive. @ 


Example 10. Let A = {1,2, 3,4} and let 
R = {(1, 2), (1, 3), 4 2)}. 
Is R transitive? 


Solution: Since there are 10 elements a, b, and c in A such that a R b and 
b Rc, but a Rc, we conclude that R is transitive. . 4 
A relation R is transitive if and only if its matrix Mz = [m,] has the 
property 
if m,=1 and m,=1, then m, = 1. 


The left-hand side of this statement simply means that (M,)?, has a 1 in position 
i, k. Thus the transitivity of R raeans that if (M,)% has a 1 in any position, 
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then M, must have a 1 in the same position. Thus, in particular, if (Mz)% = Ma, 
then R is transitive. The converse is not true. 


Example 11. Let A = {1,2,3} and let R be the relation on A whose matrix is 


Show that 2 is transitive. 


Solution: By direct computation, (M,)3 = M,; therefore, R is transitive. @ 


To see what transitivity means for the digraph of a relation, we translate the 
definition of transitivity into geometric terms. 

If we consider particular vertices a and c, the conditions a R b and b Re 
mean that there is a path of length 2 in R from a to c. In other words, a R? c. 
Therefore, we may rephrase the definition of transitivity as follows: If a R? c, then 
a Rc; that is, R? C R (as subsets of A X A). In other words, if a and c are connected 
by a path of length 2 in R, then they must be connected by a path of length 1. 

We can slightly generalize the foregoing geometric characterization of tran- 
sitivity as follows. 


Theorem 1. A relation R is transitive if and only if it satisfies the following prop- 
erty: If there is a path of length greater than 1 from vertex a to vertex b, there is a 
path of length 1 from ato b (that is, a is related to b). Algebraically stated, R is tran- 
sitive if and only if R" C R for alin = 1. 


Proof: The proof is left to the reader. ° 


It will be convenient to have a restatement of some of the properties above 
in terms of R-relative sets. We list these statements without proof. 


Theorem 2. Let RX be a relation on a set A. Then 
(a) Reflexivity of R means that a © R(a) for alla in A. 


(b) Symmetry of R means that a € R(d) if and only if b € R(a). 
(c) Transitivity of R means that if b € R(a) andc € R(b), then c € R(a). 
4 


EXERCISE SET 4.4 


In Exercises 1 through 8, let A = (1, 2, 3, 4}. 
Determine whether the relation is reflexive, 
irreflexive, symmetric, asymmetric, antisymmet- 
ric or transitive. 


1. R = {(1,1), (1,2), (2, 1), (2, 2), (3, 3), (3, 4), (4,3), 
4)} 


ry 


2. R = {(1,2), (1,3), CL, 4), (2, 3), (2, 4), (3, 4)} 
3. R= [(1,3), (1), B,D, (1, 2), 3,3), 4, 4) 
4. R= {d, 1), (2, 2), (3, 3)) 


& R=0 
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6 R=AXA 


7 R= {(1,2),(,3), (3,1), (1, 1), 3,3), 3,2), (4), 
(4,2), GB, 4)} 


8 R= {(1,3), (4,2), (2,4), , 1), (2, 2)) 


In Exercises 9 and 10 (Figures 4.22 and 4.23), let 
A = {1,2,3,4, 5}. Determine whether the relation 
R whose digraph is given is reflexive, irreflexive, 
symmetric, asymmetric, antisymmetric, or tran- 
sitive, 


Figure 4.22 


10. 


Figure 4.23 


In Exercises 11 and 12, let A = {1, 2, 3, 4}. 
Determine whether the relation R whose matrix 
Mg is given is reflexive, irreflexive, symmetric, 
asymmetric, antisymmetric, or transitive. 


0101 1 10 0 
1011 1100 
an ee ma ee ee 
110 0 0001 


In Exercises 13 through 22, determine whether 
the relation R on the set A is reflexive, irreflex- 
ive, symmetric, asymmetric, antisymmetric, or 
transitive. 


13. A = Z;aR bifandonlyifasb+1. 
14. A = Z*;aR b if and only if |a - b| = 2. 


15. A = Z*;a@ Rb if and only if a = b* for some 
kEZ. 


16. A = Z;a R bif and only if a + bis even. 
17. A = Z;a R bif and only if ja — bj = 2. 


18. A = the set of real numbers; a R 5b if and only if 
+h =4, 


19. A = Z*;aR b if and only if GCD(a, b) = 1.In 
this case, we say that a and b are relatively 


prime. (See Section 1.4 for GCD.) 


20. A = the set of all ordered pairs of real num- 
bers; (a, 5) R (c, d) if and only if a = c. 


21. S = {1,2,3,4},A = S x S; (a,b) R (c,d) if and 
only if ad = be. 


22. 


A is the set of all lines in the plane; /, R 1, if and 
only if J, is parallel to J). 


23. Let R be the following symmetric relation on 
the set A = {1, 2, 3,4, 5}. 


R = {(1, 2), (2,1), (3, 4), (4, 3), G5), Gs 3), 
(4,5), (5, 4), (S, 5)}- 
Draw the graph of R. 


24. Let A = {a, b,c, d} and let R be the symmetric 
relation 
R = {(a, b), (6, 2), (2, ©), (c, a), (4, d), (d, a)}. 
Draw the graph of R. 
25. Consider the graph of a symmetric relation R 
on A = {1,2, 3, 4,5, 6, 7} shown in Figure 4.24. 
Determine R (list all pairs). 


Figure 4.24 


26. Consider the graph of a symmetric relation R 
on A = {a, b,c, d, e} shown in Figure 4.25. 
Determine R (list all pairs). 


27. Show that if a relation on a set A is transitive 
and irreflexive, then it is asymmetric. 


28. Prove that if a relation R on a set A is symmet- 
ric, then the relation R* is also symmetric. 


4.5, Equivalence Relations 
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Figure 4.25 


29. Prove by induction that if a relation R on a set 
A is symmetric, then R” is symmetric for n = 1. 


30. Let R be a nonempty relation on a set A. 
Suppose that R is symmetric and transitive. 
Show that R is not irreflexive. 


A relation R on a set A is called an equivalence relation if it is reflexive, sym- 


metric, and transitive. 


Example 1. Let A be the set of all triangles in the plane and let R be the rela- 


tion on A defined as follows: 


R = {(a,b) € A X A| ais congruent to 5}. 


It is easy to see that R is an equivalence relation. e 


Example 2. Let A = {1, 2,3, 4} and let 
R= {(, 1), (1,2), (2, 1), (2, 2), (3,4), (4, 3), G, 3), (4, 4)}. 


It is easy to verify that R is an equivalence relation. Sd 


Example 3. Let A = Z, the set of integers, and let R be defined by a R b if and 
only if a = b. Is R an equivalence relation? 


Solution: Since a < a, R is reflexive. If a = b, it need not follow that b <a, 
so R is not symmetric. Incidentally, R is transitive, since a = b and b =c 
imply that a = c. We see that R is not an equivalence relation. Sd 


Example 4. Let A = Z and let 


R= {(a,b) € A X Al|a=r (mod 2) and b = r (mod 2)}. 
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That is, a R b if and only if @ and b yield the same remainder, r, when divided by 
2. In this case, we write a = b (mod 2), read “a is congruent to b mod 2.” 
Show that congruence mod 2 is an equivalence relation. 


Solution: First, clearly a = a (mod 2), Thus R is reflexive. 

Second, if a = b (mod 2), then a = r (mod 2) and b = r (mod 2), so 
b = a (mod 2). R is symmetric. 

Finally, suppose that a = b (mod 2) and b = c (mod 2). Then, a = r 
(mod 2), b =r (mod 2), and c = r (mod 2). That is, all three yield the same 
remainder when divided by 2. Thus, a = ¢ (mod 2). Hence congruence 
mod 2 is an equivalence relation. Sd 


Example 5. Let A = Z and let n € Z*. We generalize the relation defined in 
Example 4 as follows. Let 


R = {(a,b) € A X A|a=b (mod an)}. 


That is, a = b (mod n) if and only if a and b yield the same remainder when di- 
vided by n. Proceeding exactly as in Example 4, we can show that congruence 
mod x is an equivalence relation. o 


Equivalence Relations and Partitions 


The following result shows that if 9 is a partition of a set A (see Section 4.1), then 
# can be used to construct an equivalence relation on A. 


Theorem 1. Let? be a partition of a set A. Recall that the sets in P are called the 
blocks of P. Define the relation R on A as follows: 


aRb_ ifandonlyif aand b are members of the same block. 


Then R is an equivalence relation on A. 


Proof 

(1) If a € A, then clearly a is in the same block as itself; so a R a. 

(2) If a R b, then a and 6 are in the same block; so b R a. 

(3) Ifa R b and b Rc, then a, b, and c must all lie in the same block of #. 
Thusa Re. 


Since R is reflexive, symmetric, and transitive, R is an equivalence relation. 
R will be called the equivalence relation determined by %. Sd 


Example 6. Let A = {1, 2,3, 4] and consider the partition F = {{1, 2, 3}, {4}} of 
A. Find the equivalence relation R on A determined by #. 


Solution: The blocks of 2 are {1, 2, 3} and {4}. Each element in a block is 
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related to every other element in the same block and only to those ele- 
ments. Thus, in this case, 


R = {(1, 1), G, 2), (1, 3), (2, D, (2, 2), (2, 3), (3, 1), (3, 2), 3, 3), (4,4). © 


If P is a partition of A and R is the equivalence relation determined by ?, 
then the blocks of ¥ can easily be described in terms of R. If A, is a block of F 
and a € A,, we see by definition that A, consists of all elements x of A with 
a Rx. That is, A, = R(a). Thus the partition # is {R(a) | a € A}. In words,  con- 
sists of all distinct R-relative sets that arise from elements of A. For instance, in 
Example 6 the blocks {1, 2, 3} and {4} can be described, respectively, as R(1) and 
R(4). Of course, {1, 2, 3} could also be described as R(2) or R(3), so this way of 
representing the blocks is not unique. 

The foregoing construction of equivalence relations from partitions is very 
simple. We might be tempted to believe that few equivalence relations could be 
produced in this way. The fact is, as we will now show, that all equivalence rela- 
tions on A can be produced from partitions. 

We begin with the following result. Since its proof uses Theorem 2 of 
Section 4.4, the reader might first want to review that theorem. 


Lemma 1". Let R be an equivalence relation ona set A, and leta G Aandb € A. 
Then 


aRb ifandonlyif R(a) = R(b). 


Proof: First suppose that R(a) = R(b). Since R is reflexive, b € R(b); 
therefore, b € R(a), soa Rb. 
Conversely, suppose that a R b. Then note that 


1. b € R(a) by definition; therefore, since R is symmetric, 
2. a € R(b) by Theorem 2(b) of Section 4.4. 


We must show that R(a) = R(b). First, choose an element x € R(b). 
Since R is transitive, the fact that x € R(b), together with (1) above, implies 
by Theorem 2(c) of Section 4.4 that x © R(a). Thus R(b) C R(a). Now 
choose y € R(a). This fact and (2) above imply, as before, that y € R(b). Thus 
R(a) C R(b), so we must have R(a) = R(b). °° 


We now prove our main result. 


Theorem 2. Let R be an equivalence relation on A, and let P be the collection of 


all distinct relative sets R(a) for a in A. Then F is a partition of A, and R is the 
equivalence relation determined by P. 


Proof: According to the definition of a partition, we must show the fol- 
lowing two properties: 

(a) Every element of A belongs to some relative set. 

(b) If R(a) and R(b) are not identical, then R(a) N R(b) = ©. 


+ A lemma is a theorem whose main purpose is to aid in proving some other theorem. 
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Now property (a) is true, since a € R(a) by reflexivity of R. To show prop- 
erty (b) we prove the follcwing equivalent statement: 


If R(a)  R(b) #, then R(a) = Rib). 


To prove this, we assume that c € R(a) N R(b). Thena ReandbRe. 
Since R is symmetric, we have c R b. Thena Rc andc R b, so, by trans- 
itivity of R, a R b. Lemme | then tells us that R(a@) = R(b). We have now 
proved that # is a partition, By Lemma 1 we see that a 2 0 if and only if a 
and b belong to the same block of ?. Thus # determines R, and the theo- 
rem is proved. ¢ 


If R is an equivalence relation on A, then the sets R(a) are traditionally 
called equivalence classes of &. Some authors denote the class R(a) by [a] (see 
Section 9.3). The partition ¢ constructed in Theorem 2 therefore consists of all 
equivalence classes of R, and this partition will be denoted by A/R. Recall that 
partitions of A are also called quotient sets of A, and the notation A/R reminds 
us that # is the quotient set of A that is constructed from and determines R. 


Example 7. Let & be the relation defined in Example 2. Determine A/R. 


Solution: From Example 2 we have R(1) = {1, 2} = R(2). Also, R(3) = 
{3, 4) = R(4). Hence A/R = {{1, 2}, (3, 4}}. ° 


Example 8. Let R be the equivalence relation defined in Example 4. Determine 
AIR. 


Solution: First, R(O) = {..., —6, —4, —2, 0, 2, 4, 6, 8,...]}, the set of even 
integers, since the remainder is zero when each of these numbers is divided 
by 2. 

RA) ={..., -5, -3, -1,0,1,3,5,7,...}, 


the set of odd integers, since each gives a remainder of 1 when divided 
by 2. Hence A/R consists of the set of even integers and the set of odd 
integers. A 


From Examples 7 and 8 we can extract a general procedure for determin- 
ing partitions A/R for A finite or countable. The procedure is as follows: 


STEP 1. Choose any element of A and compute the equivalence class R(a). 


STEP 2. If R(a) # A, choose an ¢lement b, not included in R(a), and compute the 
equivalence class R(b). 


STEP 3. If A is not the union of previously computed equivalence classes, then 
choose an element x of A that is not in any of those equivalence classes and 
compute R(x). 


STEP 4. Repeat step 3 until all elements of A are included in the computed equiv- 
alence classes. If A is countable, this process could continue indefinitely. In 
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that case, continue until a pattern emerges that allows you to describe or give 
a formula for all equivalence classes. 


EXERCISE SET 4.5 


In Exercises 1 and 2, let A = {a, b,c}. Determine 
whether the relation R whose matrix Ma is given 
is an equivalence relation. 


10 0 
1 Mg=/o 1 1 
011 
101 
2M,=]0 1 0 
001 


In Exercises 3 and 4 (Figures 4.26 and 4.27), 
determine whether the relation R whose digraph 
is given is an equivalence relation. 


3. 


Figure 4.26 


Figure 4.27 


In Exercises 5 through 12, determine whether the 
relation R on the set A is an equivalence relation. 


§. A = {a, b, c,d}, R = {(a, a), (6, a), (6, 5), (c, c), 
(d, 4), (d, c)} 


6. A= {1,2,3, 4, 5}, R = ((1, 1), (1, 2), (1, 3), (2, 
1), 2, 2), G, 1), 2, 3), G, 3), 4,9, G 2), (5, 5) 


7. A= {1, 2,3, 4), R = {C, D, (1,2), (2, D, (2,2), 
(3, D, G3, 3), A, 3), 4, 1), G, 4) 


8. A = the set of all members of the Software-of- 
the Month Club; a R 5 if and only if a and b 
buy the same number of programs. 


9. A = the set of all members of the Software-of- 
the Month Club; a R b if and only if a and b 
buy the same programs. 


10. A = the set of all people in the Social Security 
database; a R b if and only if a and 5 have the 
same last name. 


1. A = the set of all triangles in the plane; a R b if 
and only if a is similar to b. 


12. A = Z* X Z*; (a, b) R (c, d) if and only if 
b=d. 

13. If {{a, c, e}, {b, d, f}} is a partition of the set 

A = {a, b, c, d, e, f}, determine the correspond- 

ing equivalence relation R. 


14. If {{1, 3, 5}, {2, 4}} is a partition of the set 
A = {1, 2, 3, 4, 5}, determine the corresponding 
equivalence relation R. 


15. Let S = {1, 2, 3, 4, 5} and let A = S x S. Define 
the following relation R on A: (a, b) R (a’, b’) if 
and only if ab’ = a’b. 

(a) Show that R is an equivalence relation. 
(b) Compute A/R. 
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16. Let S = {1, 2, 3, 4} and let A = S x S. Define 
the following relation R on A: (a, b) R (a@’, b’) if 
and only ifa +b =a’ + b’. 

(a) Show that R is an equivalence relation. 
(b) Compute A/R. 

17. A relation R ona set A is called circular if 

aR band b Rcimply c R a. Show that R is 

reflexive and circular if and only if it is an 
equivalence relation. 


. 


18. Show that if R, and R, are equivalence rela- 


tions on A, then R, M R, is an equivalence rela- 
tion on A. 


19. Define an equivalence relation R on Z, the set 
of integers, different from that used in 
Examples 4 and 8 and whose corresponding 
partition contains exactly two infinite sets. 


20. Define an equivalence relation R on Z, the set 
of integers, whose corresponding partition con- 
tains exactly three infinite sets. 


4.6. Computer Representation of Relations and Digraphs 


The most straightforward method of storing data items is to place them in a lin- 
ear list or array. This generally corresponds to putting consecutive data items in 
consecutively numbered storage locations in a computer memory. Figure 4.28 
illustrates this method for five data items D,,..., D;. The method is an efficient 
use of space and provides, at least at the level of most programming languages, 
random access to the data. Thus the linear array might be A and the data would 
be in locations A[1], A[2], A[3], A[4], A[5], and we would have access to any data 
item D, by simply supplying its index i. 


Figure 4.28 


The main problem with this storage method is that we cannot insert new 
data between existing data without moving a possibly large number of items. 
Thus, to add another item E to she list in Figure 4.28 and place E between D, and 
D,, we would have to move D, tc A[4], D, to A[5], and D, to A[6], if room exists, 
and then assign E to A[3]. 

An alternative method of representing this sequence is by a linked list, 
shown in schematic fashion in Figure 4.29. The basic unit of information storage 
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is the storage cell. We imagine such cells to have room for two information items. 
The first can be data (numbers or symbols), and the second item is a pointer, that 
is,a number that tells us (points to) the location of the next cell to be considered. 
Thus cells may be arranged sequentially, but the data items that they represent 
are not assumed to be in the same sequence. Instead, we discover the proper data 
sequence by following the pointers from each item to the next. 

As shown in Figure 4.29, we represent the storage cell as a partitioned box 
| DATA | @], with a dot in the right-hand side representing a pointer. A line is 
drawn from each such dot to the cell that the corresponding pointer designates 
as next. The symbol ®—=- means that data have ended and that no further point- 


ers need be followed. 

In practice, the concept of a linked list may be implemented using two lin- 
ear arrays, a data array A and a pointer array P, as shown in Figure 4.30. Note 
that once we have accessed the data in location A[i], then the number in location 
P{i] gives, or points to, the index of A containing the next data item. 

Thus, if we were at location A[3], accessing data item D,, then location P[3] 
would contain 5, since the next data item, D,, is located in A[5]. A zero in some 
location of P signifies that no more data items exist. In Figure 4.30, P[4] is zero 
because A[4] contains Ds, the last data item. In this scheme, we need two arrays 
for the data that we previously represented in a single array, and we have only 
sequential access. Thus we cannot locate D, directly, but must go through the 
links until we come to it. The big advantage of this method, however, is that the 
actual physical order of the data does not have to be the same as the logical, or 
natural, order. In the example above, the natural order is D,D,D,D,Ds, but the 
data are not stored this way. The links allow us to pass naturally through the data, 
no matter how they are stored. Thus it is easy to add new items anywhere. If we 


Figure 4.29 Figure 4.30 
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want to insert item £ between D), and D,, we adjoin E to the end of the array A, 
change one pointer, and adjoin another pointer, as shown in Figure 4.31. This 
approach can be used no matter how long the list is. We should have one addi- 
tional variable START holding the index of the first data item. In Figures 4.30 
and 4.31, START would contain 2 since D, is in A[2]. 


Figure 4.31 


It does not matter how large the data item is, within computer constraints, 
so A might actually be a two-dimensional array or matrix. The first row would 
hold several numbers describing the first data item, the second row would 
describe the next data item, anc so on. The data can even be a pointer to the loca- 
tion of the actual data. 

The problem of storing information to represent a relation or its digraph 
also has two solutions similar tc those presented above for simple data. In the 
first place, we know from Section 4.2 that a relation R on A can be represented 
by an » X n matrix M, if A has » elements. The matrix M, has entries that are 
0 or 1. Then a straightforward way of representing R in a computer would be by 
ann X n array having 0’s and 1’s stored in each location: Thus, if A = {1, 2} and 
R = {(1, 1), (1, 2), (2, 2)}, then 


and these data could be represented by a two-dimensional array MAT, where 
MATT[I, 1] = 1, MAT[1, 2] = 1, MAT[2, 1] = 0, and MATT[2, 2] = 1. 

A second method of storing data for relations and digraphs uses the linked 
list idea described above. For clarity, we use a graphical language. A linked list 
will be constructed that contains all the edges of the digraph, that is, the ordered 
pairs of numbers that determine those edges. The data can be represented by two 
arrays, TAIL and HEAD, giving the beginning vertex and end vertex, respec- 
tively, for all arrows. If we wish to make these edge data into a linked list, we will 
also need an array NEXT of pcinters from each edge to the next edge. 
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Consider the relation whose digraph is shown in Figure 4.32. The vertices 
are the integers 1 through 6 and we arbitrarily number the edges as shown. 


Figure 4.32 


If we wish to store the digraph in linked-list form so that the logical order coin- 
cides with the numbering of edges, we can use a scheme such as that illustrated 
in Figure 4.33. START contains 2, the index of the first data item, the edge (2, 3) 
(this edge is labeled with a 1 in Figure 4.32). This edge is stored in the second 
entries of TAIL and HEAD, respectively. Since NEXT[2] contains 10, the next 
edge is the one located in position 10 of TAIL and HEAD, that is, (1,2) (labeled 
edge 2 in Figure 4.32). 

NEXT[10] contains 5, so we go next to data position 5, which contains the 
edge (5, 4). This process continues until we reach edge (3, 6) in data position 7. 
This is the last edge, and this fact is indicated by having NEXT[7] contain 0. We 
use 0 as a pointer, indicating the absence of any more data. 

If we trace through this process, we will see that we encounter the edges in 
exactly the order corresponding to their numbering. We can arrange, in a similar 
way, to pass through the edges in any desired order. 

This scheme and the numerous equivalent variations of it have important 
disadvantages. In many algorithms, it is efficient to locate a vertex and then 
immediately begin to investigate the edges that begin or end with this vertex. This 
is not possible in general with the storage mechanism shown in Figure 4.33, so we 
now give a modification of it. We use an additional linear array VERT having one 
position for each vertex in the digraph. For each vertex 7, VERT[J] is the index, 
in TAIL and HEAD, of the first edge we wish to consider leaving vertex / (in the 
digraph of Figure 4.32, the first edge could be taken to be the edge with the small- 
est number labeling it). Thus VERT, like NEXT, contains pointers to edges. For 
each vertex /, we must arrange the pointers in NEXT so that they link together 
all edges leaving /, starting with the edge pointed to by VERT[/]. The last of these 
edges is made to point to zero in each case. In a sense, the data arrays TAIL and 
HEAD really contain several linked lists of edges, one list for each vertex. 
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START TAIL HEAD NEXT 

1 3 9 
2 3 10 
2 1 4 
3 e 8 
5 4 1 
3 4 3 
3 6 0 
6 1 7 
1 6 6 
1 2 5 


Figure 4.33 


This method is shown in Figure 4.34 for the digraph of Figure 4.32. Here 
VERT[1] contains 10, so the first edge leaving vertex 1 must be stored in the 
tenth data position. This is edge (1, 3). Since NEXT[10] = 9, the next edge leav- 
ing vertex 1 is (1, 6) located in data position 9. Again NEXT[9] = 1, which points 
us to edge (1, 2) in data position 1. Since NEXT[1] = 0, we have come to the end 
of those edges that begin at veriex 1. The order of the edges chosen here differs 
from the numbering in Figure 4.32. 

We then proceed to VERT[2] and get a pointer to position 2 in the data. 
This contains the first edge leaving vertex 2, that is, (2,3), and we can follow the 
pointers to visit all edges coming from vertex 2. In a similar way, we can trace 
through the edges (if any) coming from each vertex. Note that VERT[4] = 0, sig- 
nifying that there are no edges beginning at vertex 4. 

Figure 4.35 shows an alternative to Figure 4.34 for describing the digraph. 
The reader should check the accuracy of the method described in Figure 4.35. We 
remind the reader again that the ordering of the edges leaving each vertex can be 
chosen arbitrarily. 


VERT TAIL HEAD NEXT 
10 1 2 0 
2 2 3 3 
4 2 1 0 
0 3 5 6 
5 5 4 0 
8 3 4 7 
3 6 0 
6 1 0 
1 6 1 
1 3 9 


Figure 4.34 


Sec. 4.6 | Computer Representation of Relations and Digraphs 141 


VERT TAIL HEAD NEXT 
9 1 2 0 
3 2 3 0 
6 2 1 2 
0 3 5: 7 
5 5 4 0 
8 3 4 4 
3 6 0 
6 1 0 
1 6 10 
1 3 1 
Figure 4.35 


We see then that we have (at least) two methods for storing the data for a 
relation or digraph, one using the matrix of the relation and one using linked lists. 
A number of factors determines the choice of method to be used for storage. The 
total number of elements n in the set A, the number of ordered pairs in R or the 
ratio of this number to n? (the maximum possible number of ordered pairs), and 
the possible information that is to be extracted from R are all considerations. An 
analysis of such factors will determine which of the storage methods is superior. 
We will consider two cases. 

Suppose that A = {1,2,...,N}, and let R be a relation on A, whose matrix 
Mg is represented by the array MAT. Suppose that R contains P ordered pairs so 
that MAT contains exactly P ones. First, we will consider the problem of adding 
a pair (J, J) to R and, second, the problem of testing R for transitivity. 

Adding (J, J) to R is accomplished by the statement 


MATII,J] < 1. 


This is extremely simple with the matrix storage method. 

Now, consider the following algorithm, which assigns RESULT the value T 
(true) or F (false), depending on whether R is or is not transitive. We note that 
TRANS does not report whether R is transitive or not. 


ALGORITHM TRANS 
1. RESULT —T 
2. FORI=1THRUN 
a. FORJ=1THRUN 
1. IF (MAT{IZ, J] = 1) THEN 
a. FOR K = 1THRUN 
1. IF (MAT{J, K] = 1 and MAT{J, K] = 0) THEN 
a. RESULT <—F 
END OF ALGORITHM TRANS 


Here RESULT is originally set to T, and it is changed only if a situation is 
found where (/, J) € R and (/, K) € R, but (7, K) € R (a situation that violates 
transitivity). 
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We now provide a count of the number of steps required by algorithm 
TRANS. Observe that J and J cach run from 1 to N. If (J, /) is not in R, we only 
perform the one test “IF MAT[/, J] = 1,” which will be false, and the rest of the 
algorithm will not be executed. Since N? — P ordered pairs do not belong to R, 
we have N? — P steps that must be executed for such elements. If (J, /) © R, then 
the test “IF MAT{J, J] = 1” will be true and an additional loop 


a. FOR K = 1THRUN 
1. IF (MATIJ, K] = ( and MAT{I, K] = 0) THEN 
a. RESULT —F 


of N steps will be executed. Since R contains P ordered pairs, we have PN steps 
for such elements. Thus the total number of steps required by algorithm TRANS 
is 


T, = PN+ (N? - P). 


Suppose that P = KN”, where 0 << k = 1,since P must be between 0 and N”.Then 
algorithm TRANS tests for transitivity in 


T, = kN? + (1—k)N? 
steps. 
Now consider the same digraph represented by our linked-list scheme using 
VERT, TAIL, HEAD, and NEXT. First we deal with the problem of adding an 
edge (/, J). We assume that TAIL, HEAD, and NEXT have additional unused 


positions available and that the total number of edges is counted by a variable P. 
Then the following algorithm adds an edge (J, /) to the relation R. 


ALGORITHM ADDEDGE 
1. PeP+ti 

2. TAIL[P] —/ 

3. HEAD[P] <J/ 

4. NEXT[P] < VERT{/] 

5. VERT[/] <P 


END OF ALGORITHM ADDEDGE 


Figure 4.36 shows the situation diagrammatically in pointer form, both 
before and after the addition of edge (7,7). VWERT[/] now points to the new edge, 
and the pointer from that edge goes to the edge previously pointed to by 
VERT[/], that is, U/, J’). This method is not too involved, but clearly the matrix 
storage method has the advantage for the task of adding an edge. 

We next consider the transitivity problem. To keep matters simple, we 
assume that there is available to us a function EDGE(T, J) that has the value T if 
U, J) is in R, or otherwise the value F. The reader will be asked to construct such 
a function in the exercises. The following algorithm tests for transitivity of R with 
this storage method. Again, RESULT will have value T if R is transitive and, oth- 
erwise, will have value F 


ALGORITHM NEWTRANS 
1. RESULT <—T 
2. FORI = 1THRUN 

a. X<VERT{/] 
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b. WHILE (X # 0) 
1. J© HEAD[X] 
2. Y<VERT(J] 
3. WHILE(Y # 0) 
a. K«HEAD[Y] 
b. TEST « EDGE[/, K] 
c. IF (TEST) THEN 
1. Y<NEXT[Y] 
d. ELSE 
1. RESULT —F 
2. Y<NEXT[Y] 
4. X<NEXT[X] 
END OF ALGORITHM NEWTRANS 


VERT TAIL HEAD 


Blank 
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The reader should follow the steps of this algorithm with several simple 
examples. For each vertex /, it searches through all paths of length 2 beginning at 
Zand checks these for transitivitv. Thus it eventually checks each path of length 2 
to see if there is an equivalent direct path. Algorithm NEWTRANS is somewhat 
longer than algorithm TRANS, which corresponds to the matrix method of stor- 
age, and NEWTRANS also uses the function EDGE; but it is much more like the 
human method of determining the transitivity of R. Moreover, NEWTRANS 
may be more efficient. 

Let us analyze the average: number of steps that algorithm NEWTRANS 
takes to test for transitivity. Eact: of the P edges begins at a unique vertex, so, on 
the average, P/N = D edges begin at a vertex. It is not hard to see that a function 
EDGE, such as needed above, can be made to take an average of about D steps, 
since it must check all edges beginning at a particular vertex. The main FOR loop 
of NEWTRANS will be executed N times, and each subordinate WHILE state- 
ment will average about D executions. Since the last WHILE calls EDGE each 
time, we see that the entire algor.thm will average about ND? execution steps. As 
before, we suppose that P = KN? with 0 < k < 1. Then NEWTRANS averages 
about 


Ti, =N ( = k7N* steps. 


Recall that algorithm TRANS, using matrix storage, required about T, = 
kN? + (1 — k)N? steps. 

Consider now the ratio T,/T,, of the average number of steps needed with 
linked storage versus the number of steps needed with matrix storage to test R 
for transitivity. Thus 


T, __&3N4 k?N 

Ty kN?+(1 — k)N? 1 1° 
+ aot agg: at 
Pe lg 


When &k is close to 1, that is, when there are many edges, then T,| T, is 
nearly N,so T, = T,N, and tke linked-list method averages N times as many 
steps as the matrix-storage method. Thus the matrix-storage method is N times 
faster than the linked-list metho«l in most cases. 

On the other hand, if k is very small, then T,/T., may be nearly zero. This 
means that if the number of edges is small compared with N?, it is, on average, 
considerably more efficient to test for transitivity in a linked-list storage method 
than with adjacency matrix storage. 

We have, of course, made some oversimplifications. All steps do not take 
the same time to execute, and each algorithm to test for transitivity may be short- 
ened by halting the search when the first counterexample to transitivity is dis- 
covered. In spite of this, the conclusions remain true and illustrate the important 
point that the choice of a data s:ructure to represent objects such as sets, rela- 
tions, and digraphs has an important effect on the efficiency with which informa- 
tion about the objects may be exiracted. 
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Virtually all relations and digraphs of practical importance are too large to 
be explored by hand. Thus the computer storage of relations and the algorithmic 
implementation of methods for exploring them are of great importance. 


EXERCISE SET 4.6 


1. Verify that the linked-list arrangement of Describe arrays VERT, TAIL, HEAD, and 
Figure 4.35 correctly describes the digraph of NEXT, setting up a linked-list representation of 
Figure 4.32. R, so that the edges out of each vertex are 

reached in the list in increasing order (relative 

2. Construct a function EDGE(/, J) (in pseudo- to their numbering in Figure 4.37). 


code) that returns the value T (true) if the pair 
(i,/) isin R and F (false) otherwise. Assume 
that the relation R is given by arrays VERT, 
TAIL, HEAD, and NEXT, as described in this 
section. 


3. Show that the function EDGE of Exercise 2 
runs in an average of D steps, where D = PIN, 
P is the number of edges of R, and N is the 
number of vertices of R. (Hint: Let P, be the 
number of edges running from vertex i to ver- 
tex j, Express the total number of steps execut- 
ed by EDGE for each pair of vertices and then 
average. Use the fact that 3, . 1 P,= P.) 

T= 


Figure 4.37 


4. Let NUM be a linear array holding N positive 
integers, and let NEXT be a linear array of the 


same length. Suppose that START is a pointer Te (Considee ihe following artays 


to a “first” integer in NUM, and for each J, VERT = [1,2, 6, 4] 
NEXT[/] points to the “next” integer in NUM TAIL =(1,2.2.4.4,3.4.1 
to be considered. If NEXT[/] = 0, the list ends. Lye 2A Ad] 
Write a function LOOK(NUM, NEXT, HEAD = [2, 2,3, 3,4,4, 1, 3] 
START, N, K) in pseudocode to search NUM NEXT = J8, 3, 0, 5,7, 0, 0, 0] 


using the pointers in NEXT for an integer K. If 
K is found, the position of K in NUM is 
returned. If not, LOOK prints “NOT FOUND.” 


These describe a relation R on the set A = 
{1, 2, 3, 4]. Compute both the digraph of R and 
the matrix My. 


5. Let A = {1,2,3, 4] and let R = {(1,1), (1.2), 
(1, 3), (2, 3), (2, 4), (3, 1), (3,4), (4, 2)} be a rela- 
tion on A. Compute both the matrix My giving 
the representation of R and the values of arrays 


8. The following arrays describe a relation R on 
the set A = {1,2,3, 4,5}. Compute both the 


VERT, TAIL, HEAD, and NEXT describing R dis teprony andthe mate Me 

as a linked list. You may link in any reasonable VERT = [6, 2, 8, 7, 10} 

way. TAIL = (2, 2, 2, 2, 1, 1, 4, 3, 4, 5] 
6. Let A = (1,2,3,4} and let R be the relation HEPES eo Py een Oe eal 


whose digraph is shown in Figure 4.37. NEXT = [3, 1, 4, 0, 0, 5, 9, 0, 0, 0} 
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9. Let A = {1, 2,3, 4,5} and let R be a relation on 10. Let A = {a, b,c, d, e} and let R be the relation 
A such that described by 
100 1 #0 1001 0 
01 1 0 0 0 0 1 1 0 
M,=|]0 0 0 1 Of. Mpg=]1 1 0 0 1f. 
101041 0 1 01 =0 
010 01 100 01 
Construct a linked-list representation, VERT, Construct a linked-list representation, VERT, 
TAIL, HEAD, NEXT, for the relation R. TAIL, HEAD, NEXT, for R. 


4.7, Manipulation of Relations 


Just as we can manipulate numbers and formulas using the rules of algebra, we 
can also define operations that allow us to manipulate relations. With these oper- 
ations we can change, combine, and refine existing relations to produce new ones. 

Let R and S be relations from a set A to a set B. Then, if we remember that 
Rand § are simply subsets of .4 X B, we can use set operations on R and S. For 
example, the complement of R, R, is referred to as the complementary relation. 
It is, of course, a relation from .4 to B that can be expressed simply in terms of R: 


aRé& ifandonlyif a Rb. 


We can also form the intersection RM S and the union R U S of the relations R 
and S. In relational terms, we see that a (R M S) b means that a R b anda S b; 
a(R U S) b means that a R b ora S b. All our set-theoretic operations can be used 
in this way to produce new relations. The reader should try to give a relational 
description of the relation R &: 5 (see Section 1.2). 

A different type of operation on a relation R from A to B is the formation 
of the inverse, usually written R~'. The relation R™' is a relation from B to A 
(reverse order from R) defined by 


bR ‘a ifandonlyif aR b. 


It is clear from this that (R~')"! = R. It is not hard to see that Dom(R™!) = 
Ran(R) and Ran(R™') = Dom(R). We leave these simple facts as exercises. 


Example 1. Let A = {1,2,3, 4} and B = {a, b,c}. Let 


R = {(1, a), (1. 5), (2, 5), (2, ¢), 3, 8), (4, a)} 
and 


S = {(1, b), (2,c), (3, b), (4, b)}. 
Compute (a) R;(b) RM S;(c) R U S;and (d) R71). 
Solution 
(a) We first find 


A X B= {(1,a), 1, b), (1, c), (2, a), (2, b), (2, c), 3,4), 
(3, b), (3, c), (4, 2), (4, b), (4, 0}. 
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Then the complement of Rin A X B is 
R = {(1,c), (2, 2), (3, a), (3, c), (4, b), (4, ©)}. 
(b) We have RNS = {(1, b), G3, b), (2, c)}. 
(c) We have 
RUS = {(,a), (1, b), (2, b), (2,c), (3, b), (4, a), (4, B)). 
(d) Since (x, y) € R™ if and only if (y, x) € R, we have 
R™! = {(a, 1), (b, 1), (6, 2), (c, 2), (b, 3), (a, 4}. e 


Example 2. Let A = R. Let R be the relation = on A and let S be =. Then the 
complement of R is the relation >, since a $ b means that a > b. Similarly, the com- 
plement of S is <. On the other hand, R7' = S, since for any numbers a and b, 


aR 'b ifandonlyif bRa ifandonlyif b<a ifandonlyif a=b. 


Similarly, we have S~' = R. Also, we note that RM S is the relation of equality, 
since a (RQ S) bif and only if a s b and a = b if and only if a = 5. Since, for any 
aand b,a = b ora = b must hold, we see that RU S = A X B; that is, R U S is 
the universal relation in which any a is related to any b. ¢ 


Example 3. Let A = {a, b,c, d, e} and let R and S be two relations on A whose 
corresponding digraphs are shown in Figure 4.38. Then the reader can verify the 
following facts: 


R = {(a,a), (6, b), (a,c), (b, a), (¢, b), (c,d), (€,€), (c,.4), (d,b), 
(d, a), (d, e), (e, b), (e, a), (e, d), (e, c) 


R™ = {(b, a), (e,5), (c,c), (c, 4), (d, 4), (d, b), (c, b), (d, a), (€,€) (€,4)} 
ROS = {(a,b), (b, 2), (c,0}- rs 


Figure 4.38 
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Example 4. Let A = {1,2,3} and let R and S be relations on A. Suppose that the 
matrices of R and S are 


1 0 1 0 1 
M,=j)0 1 1] and M,=]1 1 Of. 
0 0 0 0 0 
Then we can verify that 
o 1 0 1 0 0 
Mar=|! 0 Of, M,-=|0 1 Of, 
111 1 1 0 
0 0 1 1 1 1 
Mans=]|O 1 Of, Mrys={i 1 14. 
0 ¢c 0 0 1 0 o 


Example 4 illustrates sarae general facts. Recalling the operations on 
Boolean matrices from Section 1.5, we can show (Exercise 27) that if R and S are 
relations on set A, then 


Mans = Mg/\Ms 

Mrus = MeV Ms 

My-1 = (My), 
Moreover, if M is a Boolean tmatrix, we define the complement M of Mas the 
matrix obtained from M by replacing every | in M by a 0 and every 0 by a 1. 


Thus, if 
1 0 
M=j0 1 1}, 
1 0 
then 
011 
M=/1 0 |. 
0411 


We can also show (Exercise 27) that if R is a relation on a set A, then 
Mg = Mg. 


We know that a symmietr:c relation is a relation R such that Mz = (M,)', 
and since (M,)’ = Mp-1, we see that R is symmetric if and only if R = R™'. 
We now prove a few useful properties about combinations of relations. 


Theorem 1. Suppose that R and S are relations from A to B. 
(a) IfR CS, then R" CS"). 
(b) IfR CS,thenS CR. 
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()(ROAS)1=RENS'and(RUS)1=RIVS |, 
(d) (RNS) =RUSand(RUS)=RNS. 


Proof: Parts (b) and (d) are special cases of general set properties proved 
in Section 1.2. 

We now prove part (a). Suppose that R C S and let (a, b) € R™'. Then 
(b, a) € R, so (b, a) € S. This, in turn, implies that (a, b) € S7!. Since each 
element of R7! is in S~!, we are done. 

We next prove part (c). For the first part, suppose that (a, b) © 
(R 1S)". Then (b, a) © RM S, so (b, a) € R and (b, a) € S. This means 
that (a, b) € R™' and (a,b) € S"', so (a, b) € R7! MS". The converse con- 
tainment can be proved by reversing the steps. A similar argument works to 
show that (RUS)! = RUS" o 


The relations R and R™ can be used to check if R has the properties of rela- 
tions that we presented in Section 4.4. 


Theorem 2. Let R and S be relations on a set A. 
(a) If R is reflexive, so is R™'. 
(b) If R and S are reflexive, then so are RO Sand RUS. 
(c) R is reflexive if and only if R is irreflexive. 


Proof: Let A be the equality relation on A. We know that R is reflexive if 
and only if A C R. Clearly, A = Aq',so if A C R, then A = A C R™ by 
Theorem 1, so R™' is also reflexive. This proves part (a). To prove part (b), 
we note that if AC RandA CS,thenAC RN SandA CRU S.To show 
part (c), we note that a relation S is irreflexive if and only if $M A = ©. 
Then R is reflexive if and only if A C R if and only if AM R = @ if and only 
if R is irreflexive. o 


Example 5. Let A = {1,2, 3] and consider the two reflexive relations 
R = {(1,1), (1,2), (1, 3), (2,2), (3,3) 

and 
S = {(1, 1), (, 2), (2, 2), (3, 2), (3, 3)}- 

Then 


(a) R"' = {(1, 1), (2, 1), G, 1), (2,2), (3, 3)}, so R and R™ are both reflexive. 
(b) R = {(2, 1), (2, 3), (3, 1), (3, 2)} is irreflexive while R is reflexive. 


()R AS = {Q, 1), G, 2), (2, 2), GB, 3)} and R U S = {, 1), C, 2), G, 3), 
(2, 2), (3, 2), @, 3)} are both reflexive. 


Theorem 3. Let R be a relation on a set A. Then 
(a) R is symmetric if and only if R = R™". 
(b) R is antisymmetric if and only if R ORCA. 
(c) R is asymmetric if and only if RM R7' = ©. 
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Proof: The proof is straightforward and is left as an exercise. ° 


Theorem 4. Let R and S be relations on A. 
(a) If R is symmetric, so are R™ and R. 
(b) If R and S are symmetric,so are RO Sand RUS. 


Proof: If R is symmetric. R = R™! and thus (R™')7! = R = R™!, which 
means that R~! is also symmetric. Also, (a, b) € (R)7! if and only if 
(b,a) © R if and only if (6, a) & R if and only if (a,b) ¢ R™! = R if and only 
if (a,b) € R,so R is symmetric and part (a) is proved. The proof of part te) 
follows immediately from Theorem 1(c). 


Example 6. Let A = {1,2,3} and consider the symmetric relations 


R= {(, 1), C, 2), (2, 1), C, 3), (3, 1)} 
and 

S = {(, 1), G, 2), 2, D, (2,2), G, 3)}. 
Then 


(a)R" = (4, 1), @, 1), G, 2), 3 1), (1, 3)} and R = {(2, 2), (2, 3), (3, 2), 
(3, 3)};so R | and R are symmetric. 

(b) RO S = {(1, 1), (1, 2), 2, 1} and R U S$ = {(1, 1), CL, 2), CL, 3), (2, 1), (2,2), 
(3, 1), (3, 3)}, which are both symmetric. a 


Theorem 5. Let R and S be relations on A. 
(a) (ROSY CR NS?. 
(b) If R and S are transitive, so is RO S. 
(c) If R and S are equivalence relations, so is RQ S. 


Proof: We prove part (a) geometrically. We have a (R M S)* b if and only 
if there is a path of length 2 from a to b in R 1 S. Both edges of this path 
lie in R and in S,so a R’ b and a S? b, which implies that a(R? N S”)b. To 
show part (b), recall from Section 4.4 that a relation T is transitive if and 
only if T? ¢ T. If R and S are transitive, then R? C R, S? C S, so 
(RAS) CR? 0S? [by part (a)] C RN S,so RA S is transitive. We next 
prove part (c). Relations R and S are each reflexive, symmetric, and transi- 
tive. The same properties hold for R N S from Theorems 2(b), 4(b), and 
5(b), respectively. Hence R | S is an equivalence relation. 5 


Example 7. Let R and S be equivalence relations on a finite set A, and let A/R 
and A/S be the corresponding partitions (see Section 4.5). Since RM S is an 
equivalence relation, it corresponds to a partition A/(R M S). We now describe 
A/(R MS) in terms of A/R and A/S. Let W be a block of A/(R M S$) and suppose 
that a and b belong to W. Then a(R S) b,soa Rb anda S b. Thus a and b 
belong to the same block, say X, of A/R and to the same block, say Y, of A/S. This 
means that W C X 1 Y. The steps in this argument are reversible; therefore, 
W = XN Y. Thus we can directly compute the partition A/(R N S) by See 
all possible intersections of blocks in A/R with blocks in A/S. 
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Closures 


If R is a relation on a set A, it may well happen that R lacks some of the impor- 
tant relational properties discussed in Section 4.4, especially reflexivity, symme- 
try, and transitivity. If R does not possess a particular property, we may wish to 
add related pairs to R until we get a relation that does have the required prop- 
erty. Naturally, we want to add as few new pairs as possible, so what we need to 
find is the smallest relation R, on A that contains R and possesses the property 
we desire. Sometimes R, does not exist. If a relation such as R, does exist, we call 
it the closure of R with respect to the property in question. 


Example 8. Suppose that R is a relation on a set A, and R is not reflexive. This 
can only occur because some pairs of the diagonal relation A are not in R. Thus 
R, = RU Ais the smallest reflexive relation on A containing R; that is, the reflex- 
ive closure of Ris RUA. ¢ 


Example 9. Suppose now that R is a relation on A that is not symmetric. Then 
there must exist pairs (x, y) in R such that (y, x) is not in R. Of course, (y, x) € 
R™, so if R is to be symmetric we must add all pairs from R™’; that is, we must 
enlarge R to R U R7!. Clearly, (R U R™!)"! = RU R™,s0 R U R’ is the small- 
est symmetric relation containing R; that is, R U R7! is the symmetric closure 
of R. 

If A = {a, b,c, d) and R = {(a, b), (b,c), (a,c), (c, d)}, then R™ = {(b, a), 
(c, b), (c, a), (d, c)}, so the symmetric closure of R is 


RUR™ = {(a,b), (6,4), (6,0), (c, 6), (a,c), (€,.a), (c,d), (d, ©}. ¢ 


The symmetric closure of a relation R is very easy to visualize geometric- 
ally. All edges in the digraph of R become “two-way streets” in R U R7. Thus the 
graph of the symmetric closure of R is simply the digraph of R with all edges 
made bidirectional. We show in Figure 4.39(a) the digraph of the relation R of 
Example 9. Figure 4.39(b) shows the graph of the symmetric closure R U R™. 

The transitive closure of a relation R is the smallest transitive relation con- 
taining R. We will discuss the transitive closure in the next section. 


(a) (b) 
Figure 4.39 
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Composition 


Now suppose that A, B, and C are sets, R is a relation from A to B, and S is a rela- 
tion from B to C. We can then define a new relation, the composition of R and S, 
written So R. The relation S$ R is a relation from A to C and is defined as fol- 
lows. If a is in A and c is in C, then a(S R)c if and only if for some b in B, we 
have a R b and b S c. In other words, a is related to c by So R if we can get from 
a toc in two stages: first to an intermediate vertex b by relation R and then from 
b to c by relation S. The relation S ° R might be thought of as “S following R” 
since it represents the combined effect of two relations, first R, then S. 


Example 10. Let A = {1, 2,3, 4}, R = {(1, 2), CL, D, (1, 3), (2, 4), (3, 2)}, and 
S = {(1,4), (, 3), (2,3), G, 1), (4, D}. Since (1,2) € R and (2,3) € S$, we must have 
(1,3) © So R. Similarly, since (1,1) € R and (1,4) € S, we see that (1,4) E SoR. 
Proceeding in this way, we find that Se R = {(1, 4), (1,3), 1, 1), (2,1), B,3)}. 


The following result shows how to compute relative sets for the composi- 
tion of two relations. 


Theorem 6. Let R be a relation jrom A to B and let S be a relation from B to C. 
Then, if A, is any subset of A, we have 


(So RY(A,) = S(R(A,)). 


Proof: If an element z & Cis in (Se R)(A,), then x(S ° R)z for some x in 
A,. By the definition of composition, this means that x R y and y S z for 
some y in B. Thus y € R(x), so z € S(R(x)). Since {x} C A,, Theorem 1(a) 
of Section 4.2 tells us that S(R(x)) C SCR(A,)). Hence z € S(R(A,)), so 
(S° R)(A)) C S(R(A,))- 

Conversely, suppose that z © S(R(A,)). Then z € S(y) for some y in 
R(A,) and, similarly, y € (x) for some x in A,. This means that x R y and 
y S z,so x(S ° R)z. Thus 2 € (S° R)(A,), so S(R(A,)) C (S ° R)(A,). This 
proves the theorem. 0 


Example 11. Let A = {a,b,c} and let R and S be relations on A whose matrices 
are 


1 0 1 0 0 
M,=|1 1 1], Ms={0 1 1 
0 1 0 ita es 


We see from the matrices that 


(a,a)ER and (a,a)ES, so (a,a)ESoR 
(a,c)ER and (c,a)ES, so (a,a)ESceR 
(a,c)ER and (c,c)ES, so (ac) ESR 


It is easily seen that (a,b) ¢ SR since, if we had (a,x) € R and (x, b) € S, matrix 
M, tells us that x would have to be a or c; but matrix M, tells us that neither 
(a, b) nor (c, b) is an element of S. 

We see that the first row of Ms. pis 1 0 1.The reader may show by sim- 
ilar analysis that 
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a 


1 0 
Ms.r=|1 1 
01 


We note that M,, pg = Mp © M, (verify). 5 


Example 11 illustrates a general and useful fact. Let A, B, and C be finite 
sets with , p, and m elements, respectively, let R be a relation from A to B, and 
let S be a relation from B to C. Then R and S have Boolean matrices Mp and My 
with respective sizes n X p and p X m. Then M,; © Ms; can be computed, and it 
equals My, z- 

To see this, let A = {a,,...,a,],B = {by,...,b,}, and C = {c,,...,¢,,}- Also, 
suppose that Mz = [r,], Ms = [s,], and Ms. = [¢,]. Then 4, = 1 if and only if 
(a; c;) € S° R, which means that for some &, (a, b,) € R and (b,,¢;) € S. In other 
words, r;, = 1 and s,; = 1 for some & between 1 and p. This condition is identical 
to the condition needed for Mz © M, to have a 1 in position i, j, and thus M,.z 
and M, © M, are equal. 

In the special case where R and S are equal, we have Se R = R* and 
M,. 2p = Mp: = Mz © Mg, as was shown in Section 4.3. 


Example 12. Let us redo Example 10 using matrices. We see that 


Cie Ae) Oo: 0° 4 “4 
0 0 0010 
Meas goo) et Mee oe ol? 
000 0 10 0 0 
Then 
(<0: ae 
10 0 0 
MOMs lp. co: 1 ol 
000 0 
so 


SoR = {(1, 1), (, 3), C1, 4), (2, 1), (3, 3)} 


as we found before. In cases where the number of pairs in R and S is large, the 
matrix method is much more reliable and systematic. Sd 


Theorem 7. Let A, B, C, and D be sets, Ra relation from A to B, S a relation from 
B to C, and T a relation from C to D. Then 
T°(SoR)=(TeS)oR. 


Proof: The relations R, S, and T are determined by their Boolean matri- 
ces Mr, My, and M;, respectively. As we showed after Example 11, the 
matrix of the composition is the Boolean matrix product; that is, Ms.p = 
Mrz © Mg. Thus 


Myson) = Mseg © M; = (Mg © My) © My. 
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Similarly, 


esyor = Mz © (Ms © M7). 


Since Boolean matrix multiplication is associative [see Exercise 27(c) of 


Section 1.5], we must have 


(M, © Ms) © M, = Mz © (My © M,), 


and therefore 


Then 


Mz (sR) = Mir. syor- 


Te(SoR)=(TeS)oR 


since these relations have the same matrices. . 4 


In general, Roe § # So R, as shown in the following example. 


Example 13. Let A = {a,b}, R = {(a,a), (b, a), (b, b)}, and S = {(a, b), (b, a), 
(b, b)}. Then $ ° R = {(a, b), (b, a), (b, b)}, while RS = {(a, a), (a, b), (b, a), 


(b, b)}. 


Sd 


Theorem 8. Let A, B, and C be sets, R a relation from A to B,and S a relation from 
Bto C. Then (S°R)' = R'° S71. 


Proof: Letc © Canda & A.Then (c, a) € (S° R)' if and only if (a, c) € 
So R, that is, if and only if there is ab € B with (a,b) € R and (b,c) € S. 
Finally, this is equivalent tc the statement that (c,b) € S"' and (b,a) € R71; 


that is, (c,a) € Re ST, 


EXERCISE SET 4.7 


In Exercises 1 and 2, let R and S be the given 
relations from A to B. Compute (a) R (b) RNS; 
(c) RU S;(d) S71. 


1. A = B = {1,2,3};R = {(1, 1), (1,2), (2,3), 
3,1}: S = {(2, 1). B,D. GB,2). B, 3)} 


2. A = {a,b,c}; B = (1,2, 3} R = {(a,1), (6D, 
(c, 2), (e,3)} 5 = {(a, 1), @, 2), @ 1), (@, 2) 


In Exercises 3 and 4, let R and § be two relations 
whose corresponding digraphs are shown in 
Figures 4.40 and 4.41. Compute (a) R; (b) RN 
S;(c) RUS; (d) Sh. 


o 


Figure 4.40 


Figure 4.41 


In Exercises 5 and 6, letA = {1,2,3} and B = 


(1,2, 3,4}. Let R and S be the relations from A 
to B whose matrices are given. Compute (a) S; 


(b) ROS; (c) RUS: (d) R™. 


foie Qe A OT Ski 
5. Mg =| 0 1|,M,=|1 001 
111 0 110 0 
101 0 oe in ie | 
6. Mz =| 0 1|, M,=]0 01 
111 0 01041 


In Exercises 7 and 8, let A = {1,2,3,4} and B = 


{1, 2, 3}. Given the matrices Mz and M, of the 
relations R and S from A to B, compute 
(a) Mans; (b) Mauss (©) Mg: (d) M5. 


° 


10. 


i, 


12. 
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101 0 1 =0 
011 101 

Me=}o 1 of Mela 0 a}: 
1041 111 
0 1 0 101 
0 1 1 101 

Me~lo 9 il) Ms=]o 1 of 
111 0 1 =«0 


Let A = B = {1,2,3,4},R = (11,1). (1,3), 
(2,3), 3,1), (4,2), (4, 4)}, and § = {(1, 2), (2,3), 
(3, 1), (3, 2), (4, 3)}. Compute (a) Mans: 

(b) Mauss (¢) Mp5 (4) Mg. 


Let A = (1,2,3,4,5, 6}. 


R = {(1, 2), (1, 1), (2, 1), (2, 2), 3, 3), (4, 4), 
(5, 5), (5, 6), (6, 5), (6, 6)}, and 

S = (C1, 1), (1, 2), (1, 3), (2, 1), (2, 2), (2, 3), 
(3,1), (3, 2), 3,3), (4, 6), (4, 4), (6,4), 
(6,6), (5,5)} 

be equivalence relations on A. Compute the 

partition corresponding to RN S. 


Let A = {a, b, c,d, e} and let the equivalence 
relations R and S defined on A be given by 


111140 
1114140 
M,=}]1 1 1 1 0 
11110 
000 0 1 
1 00 0 0 
01100 
M,=|0 1 1 0 0 
000141 
000141 
Compute the partition of A corresponding to 


RNS. 


Let A = {a, b,c, d}, B = {1,2, 3}, and C = 
{C, A, ©}. Let R and S be the following rela- 
tions from A to B and from B to C, respectively. 


R = {(a, 1), (a, 2), (b, 2), (b, 3), (c, 1), (4, 3), (d, 2)} 
S= {d, ), (2, A), G3, A), (a, )} 
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14. 


15, 


16. 


17. 


18. 


19. 


20. 
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(a) Is(b, A) E Se R? 
(b) Is (c, A) € Se R? 
(c) Compute $° R. 


Let A = B = the set of real numbers. Let R be 
the relation < and S be the relation >. 
Describe (a) RN S;(b) RU S;(c) St. 


Let A = aset of people. Let a R b if and only if 
a and b are brothers; let a S b if and only if a 
and b are sisters. Describe R U S. 


Let A = aset of people. Let a R b if and only if 
a is older than 6; let a S b if and only if ais a 
brother of b. Describe RM S. 


Let A = the set of all people in the Social 
Security database. Let a R b if and only if a and 
b receive the same benefits; let a S b if and only 
if a and b have the same last name. Describe 
RNS. 


Let A = a set of people. Let a R b if and only if 
a is the father of b; let a S b if and only if a is 
the mother of b. Describe R U S. 


Let A = (2,3, 6, 12} and let R and S be the fol- 
lowing relations on A: x R y if and only if 
2|@-y);x Sy if and only if 3 | (x-y). 
Compute (a) R; (b) RM S;(c) R U S;(d) S77. 


Let A = B = C = the set of real numbers. Let 
R and S be the following relations from A to B 
and from B to C, respectively: 


R = {(a,b) | a = 2b} 
S = {(b,c) | b = 3c}. 
(a) Is (1,5) © SoR? 


(b) Is (2,3) © Se R? 
(c) Describe So R. 


Let A = {1, 2, 3, 4}. Let 


R= {(1, 1), 0,2), (2, 3), 2,4), 3,4), 4, 1), 4,2) 
$={3,),44,23,(24,00,04}- 


(a) Is (1,3) © Re R? 
(b) Is (4,3) ESR? 
(c) Is(1,1) © Re S? 
(d) Compute R° R. 
(e) Compute So R. 


(f) Compute R° S. 
(g) Compute S° S. 


21. (a) Which properties of relations on a set A 
are preserved by composition? Prove your 
conclusion. 

(b) If R and S are equivalence relations on a 
set A, is S° R an equivalence relation on 
A? Prove your conclusion. 


In Exercises 22 and 23, let A = {1,2,3,4, 5} and 
let Mz and M, be the matrices of the relations R 
and § on A, Compute (a) Mz,pr; (b) Mg. x’ 

(c) Maz.s; (d) Ms. 5. 


22. 


101141 1001 0 
0 1100 10100 
Mre=]1 0 0 1 Oj}, Ms=]1 0 1 O O}. 
1010 0 0 1141 =«421 
0 111i 1000 1 
23. 1100 1 0 00 1 1 
000 1 0 1000 1 
Mr=|1 1 0 0 1), Ms=j]0 1 0 1 Oj. 
0 10i1éi21 110411 
100 0 0 101 0 0 


24, (a) Let R and S be relations ona set A. If R 
and § are asymmetric, either prove or dis- 
prove that RM Sand R U S are asymmetric. 

(b) Let R and S be relations on a set A. If R 
and S are antisymmetric, either prove or 
disprove that RM S and R U S are anti- 
symmetric. 


25. Let R be a relation from A to B and let S and T 
be relations from B to C. Prove or disprove. 
(a) (SU T)°R = (Se R) U(TeR) 
(b) (SM T)eoR=(SeR)N(TeR) 


26. Let R and S be relations from A to B and let T 
be a relation from B to C. Show that if R C S, 
then T°RCT°S. 


27. Show that if R and S are relations on a set A, 
then 


(a) Mans = Mp/\ Msg 
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(b) Meus = MeV My 29. Let R be a relation from A to B. Prove 

(c) My = (M,)" (a) Dom(R™) = Ran(R) 

(d) Mg = My (b) Ran(R*) = Dom(R) 

28. Let R and S be relations on a set A. Prove that 30. Prove Theorem 3. 
(ROS)! CR" N S", forn = 1, 


4.8. Transitive Closure and Warshall’s Algorithm 


Transitive Closure 


In this section we consider a construction that has several interpretations and 
many important applications. Suppose that R is a relation on a set A and that R 
is not transitive. We will show that the transitive closure of R (see Section 4.7) is 
just the connectivity relation R®, defined in Section 4.3. 


Theorem 1. Let R be a relation on a set A. Then R® is the transitive closure of R. 


Proof: We recall that if a and b are in the set A, then a R® b if and only if 
there is a path in R from a to b. Now R” is certainly transitive since, if 
a R” band b R” c, the composition of the paths from a to b and from b toc 
form a path from a to c in R, and so a R® c. To show that R® is the smallest 
transitive relation containing R, we must show that if S is any transitive rela- 
tion on A and R C S, then R” C S. Theorem 1 of Section 4.4 tells us that if 
Sis transitive, then S$” ¢ S for all n; that is, if a and b are connected by a path 
of length n, then a S b. It follows that S* = U%., S" C S. It is also 
true that if R C S, then R® C S$”, since any path in R is also a path in S. 
Putting these facts together, we see that if R C S and S is transitive on A, 
then R® C S* C S. This means that R® is the smallest of all transitive re- 
lations on A that contain R. 5 


We see that R” has several interpretations. From a geometric point of view, 
it is called the connectivity relation, since it specifies which vertices are connected 
(by paths) to other vertices. If we include the relation A (see Section 4.4), then 
R® U Ais the reachability relation R* (see Section 4.3), which is frequently more 
useful. On the other hand, from the algebraic point of view, R® is the transitive 
closure of R, as we have shown in Theorem 1. In this form, it plays important roles 
in the theory of equivalence relations and in the theory of certain languages (see 
Section 10.1). 


Example 1. Let A = {1,2,3,4}, and let R = {(1,2), (2, 3), (3.4), (2, 1)}. Find the 
transitive closure of R. 


Solution 


METHOD |. The digraph of R is shown in Figure 4.42. Since R® is the tran- 
sitive closure, we can proceed geometrically by computing all paths. We 
see that from vertex 1 we have paths to vertices 2, 3, 4, and 1. Note that 
the path from 1 to 1 proceeds from 1 to 2 to 1. Thus we see that the 
ordered pairs (1, 1), (1, 2), (1, 3), and (1, 4) are in R”. Starting from ver- 
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tex 2, we have paths to vertices 2, 1, 3, and 4, so the ordered pairs (2, 1), 
(2, 2), (2, 3), and (2, 4) are in R”. The only other path is from vertex 3 to 
vertex 4,s0 we have 


R® = ((1, 1), (2), (3), (1, 4), (2, D, (2, 2), (2,3), (2,4), G, 4)]- 


Figure 4.42 


METHOD 2. The matrix of 2? is 


0 1 0 0 
1 01 0 
Me~lo 0 0 if 
0 00 0 
We may proceed algebraically and compute the powers of Mz. Thus 
101 0 0 10 1 
0 10 1 101 0 
(Mao=lq 9 0 of “RO=]o 0 0 0 
0 0 0 0 00 0 0 
1 01 0 
0101 
4 an 
(MWYo=19 9 9 of 
000 0 


Continuing in this way, we can see that (Mz)% equals (M,)4 if n is even 
and equals (M,)é if n is odd and greater than 1. Thus 


111 
Ma: = Mg V (Ma)3V (Mg) = 


DR RrP RP 


1 
0 
0 


oc Ff 


1 
0 
0 
and this gives the same relation as Method 1. So 


In Example 1 we did not need to consider all powers R" to obtain R®. This 
observation is true whenever the set A is finite, as we will now prove. 


Sec. 4.8 Transitive Closure and Warshall’s Algorithm 159 


Theorem 2. Let A be a set with |A| =n, and let R be a relation on A. Then 
R° = RUR?U-*U R” 
In other words, powers of R greater than n are not needed to compute R”. 


Proof: Let a and b be in A, and suppose that a, x,,x),...,X,,,0 is a path 
from a to b in R; that is, (a, x1), (%,42),---, (5) are all in R. If x; and x; 
are equal, say i <j, then the path can be divided into three sections. First, a 
path from a to x;, then a path from x; to x;, and finally a path from x; to b. 
The middle path is a cycle, since x, = x;, so we simply leave it out and put 
the first two paths together. This gives us a shorter path from a to b (see 


Figure 4.43). 
OM 
. ! 
o t--O 


Figure 4.43 
Now let a, x,,x,...,%,,b be the shortest path from a to 6. If a # b, then 
all vertices a, x,,X,,...,,, b are distinct. Otherwise, the preceding discus- 


sion shows that we could find a shorter path. Thus the length of the path is 
at most n — 1 (since |A| = n). If a = b, then for similar reasons, the 


vertices a, X,,X2,..., x, are distinct, so the length of the path is at most n. 
In other words, if a R® b, then a R* b, for some k, 1 = k Sn. Thus R® = 
RURU--UR" ° 


The methods used to solve Example 1 each have certain difficulties. The 
graphical method is impractical for large sets and relations and is not systematic. 
The matrix method can be used in general and is systematic enough to be pro- 
grammed for a computer, but it is inefficient and, for large matrices, can be pro- 
hibitively costly. Fortunately, a more efficient algorithm for computing transitive 
closure is available. It is known as Warshall’s algorithm, after its creator, and we 
describe it next. 


Warshall’s Algorithm 


Let R be a relation ona set A = (a,,4),...,a,}. If x,,x5,...,x,, is a path in R, then 
any vertices other than x, and x,, are called interior vertices of the path. Now, for 
1<k <n,we define a Boolean matrix W, as follows. W, has a 1 in position i, j if 
and only if there is a path from a, to a; in R whose interior vertices, if any, come 
from the set {a;, a,,...,a,}. 

Since any vertex must come from the set {a,, a,...,4,}, it follows that the 
matrix W,, has a 1 in position i,j if and only if some path in R connects a, with a,. 
In other words, W, = Me. If we define Wy to be Ma, then we will have a 
sequence W,, W,,..., W,, whose first term is M, and whose last term is Mg. We 
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will show how to compute each matrix W, from the previous matrix W,_,. Then 
we can begin with the matrix of & and proceed one step at a time until, ina steps, 
we reach the matrix of R*. This procedure is called Warshall’s algorithm. The 
matrices W, are different from the powers of the matrix Ma, and this difference 
results in a considerable savings of steps in the computation of the transitive clo- 
sure of R. 

Suppose that W, = [¢;] and W,_, = [s,].If4, = 1, then there must be a path 
from a; to a, whose interior vertices come from the set (a), a,,...,@,}. If the ver- 
tex a, is not an interior vertex of this path, then all interior vertices must actually 
come from the set {a,,@),...,4,_ },808,; = 1. Ifa, is an interior vertex of the path, 
then the situation is as shown in Figure 4.44. As in the proof of Theorem 2, we 
may assume that all interior vertices are distinct. Thus a, appears only once in the 
path, so all interior vertices of subpaths 1 and 2 must come from the set 
{a,,4,,...,@,_;}. This means that s, = 1 ands, = 1. 


Subpath 1 Subpath 2 


Figure 4.44 


Thus ¢,, = 1 if and only if either 
(1) s,; =1. or 
(2) s,=1 and s,=1. 


This is the basis for Warshall’s algorithm. If W,_, has a 1 in position i, j then, by 
(1), so will W,. By (2), a new 1 can be added in position i, j of W, if and only if 
column & of W,_, has a | in position i and row & of W,_, has a 1 in position j. 
Thus we have the following procedure for computing W, from W,,_,. 


Step 1. First transfer to W, all 1’s in W,_,. 


Step 2. List the locations p,, p,, ...,in column k of W,_,, where the entry is 1, 
and the locations q,, q),...,in row k of W,_,, where the entry is 1. 


Step 3. Put 1’s in all the positions p,, q; of W, (if they are not already there). 


Example 2. Consider the relation R defined in Example 1. Then 


010 0 
101 0 
Wo Me 1G: sooo 4 
000 0 


and n = 4. 
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First we find W, so that & = 1. W, has 1’s in location 2 of column 1 and loca- 
tion 2 of row 1. Thus W, is just W, with a new 1 in position 2, 2. 


010 0 
111.0 
W~lo 001 
0000 


Now we compute W, so that & = 2. We must consult column 2 and row 2 of 
W,. Matrix W, has 1’s in locations 1 and 2 of column 2 and locations 1, 2, and 3 
of row 2. 

Thus, to obtain W,, we must put 1’s in positions 1,1, 1,2, 1,3, 2,1, 2,2, 
and 2,3 of matrix W, (if 1’s are not already there). We see that 


111 £0 
ee > a 10 
210 0 0 1) 

00 0 0 


Proceeding, we see that column 3 of W, has 1’s in locations 1 and 2, and row 
3 of W, has a 1 in location 4. To obtain W3, we must put 1’s in positions 1,4 and 
2,4 of W,, so 


11411 
11141 
We loo 0 2) 
0000 


Finally, W, has 1’s in locations 1, 2,3 of column 4 and no 1’s in row 4, so no 
new 1’s are added and M;» = W, = W;. Thus we have obtained the same result 
as in Example 1. 6 


The procedure illustrated in Example 2 results in the following algorithm 
for computing the matrix, CLOSURE, of the transitive closure of a relation R 
represented by the N X N matrix MAT. 


ALGORITHM WARSHALL 
1. CLOSURE + MAT 
2. FOR K = 1 THRUN 
a. FOR] = 1 THRUN 
1. FORJ = 1 THRU N 
a. CLOSURE [/, J] — CLOSURE [/, J] 
\v (CLOSURE [I, K] \ CLOSURE [K,J]) 
END OF ALGORITHM WARSHALL 


This algorithm was set up to proceed exactly as we have outlined previ- 
ously. With some slight rearrangement of the steps, it can be made a little more 
efficient. If we think of the testing and assignment line as one step, then algorithm 
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WARSHALL requires x’ steps in all. The Boolean product of two n X n Boolean 
matrices A and B also requires n? steps, since we must compute n’ entries, and 
each of these requires n comparisons. To compute all products (Mg)3, (Mx)d,---» 
(M,)%, we require n°(n — 1) steps, since we will need n — 1 matrix multiplications. 
The formula 


My» = Me V (Ma) VV (Mao; (1) 


if implemented directly, would require about v* steps without the final joins. Thus 
Warshall’s algorithm is a significant improvement over direct computation of 
M,~ using formula (1). 

An interesting application of the transitive closure is to equivalence rela- 
tions. We showed in Section 4.7 that if R and S are equivalence relations on a set 
A, then RM S is also an equivalence relation on A. The relation R M S is the 
largest equivalence relation contained in both R and S, since it is the largest sub- 
set of A x A contained in both FR and S. We would like to know the smallest equiv- 
alence relation that contains both R and S$.The natural candidate is R U S, but this 
relation is not necessarily transitive. The solution is given in the next theorem. 


Theorem 3. [f R and S are equivalence relations on a set A, then the smallest 
equivalence relation containing both R and S is (R U S)”. 


Proof: Recall that A is the relation of equality on A and that a relation is 
reflexive if and only if it contains A. Then A C R, A C S since both are 
reflexive,soA C RUS C(RUS)*, and (R U S)” is also reflexive. 

Since R and S are symmetric, R = R7' and § = S"',so (RU S)! = 
R'US'=RUS,and KR J S is also symmetric. Because of this, all paths 
in R U S are “two-way streets,” and it follows from the definitions that 
(R U S)* must also be symmetric. Since we already know that (R U S)* is 
transitive, it is an equivalence relation containing R U S. It is the smallest 
one, because no smaller set containing R U S can be transitive, by definition 
of the transitive closure. 6 


Example 3. Let A = {1,2,3,4, 5},R = {(1, 1), 2, 2), (2, 1), @, 2), (3, 3), (3, 4), 
(4, 3), (4, 4), (5, 5)}, and S = {(1, 1), (2, 2), (3, 3), (4, 4), (4, 5), (5, 4), (5, 5)}. The 
reader may verify that both R and S are equivalence relations. The partition 
A/R of A corresponding to R is {{1, 2}, {3, 4}, {5}}, and the partition A/S of A 
corresponding to S is {{1}, {2}, {3}, {4, 5}}. Find the smallest equivalence relation 
containing R and S, and compute the partition of A that it produces. 


Solution: We have 


1 10 0 0 100 0 0 
1 10 0 0 010 0 0 
Mre=|0 0 1 t Of] and M,=]0 0 1 O OF, 
0 01 1 0 000 11 
0 0 0 0 1 00011 
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so 


Maus = Mr V Ms = 


cooo rr 
oo oF Fe 
Orro;o 
PrP RP CO”. 
erPocoo ° 


We now compute Mays by Warshall’s algorithm. First, Wp = Maus. 
We next compute W,, so k = 1. Since W, has 1’s in locations 1 and 2 of 
column 1 and in locations 1 and 2 of row 1, we find that no new 1’s must be 
adjoined to W,. Thus 


Ww, = WwW. 

We now compute W,,so & = 2. Since W, has 1’s in locations 1 and 2 of 
column 2 and in locations 1 and 2 of row 2, we find that no new 1’s must be 
added to W,. Thus 

W,=W,. 


We next compute W3;, so k = 3. Since W, has 1’s in locations 3 and 4 of 
column 3 and in locations 3 and 4 of row 3, we find that no new 1’s must be 
added to W,. Thus 


WwW; =W). 
Things change when we now compute W,. Since W, has 1’s in locations 


3,4, and 5 of column 4 and in locations 3, 4, and 5 of row 4, we must add new 
1’s to W, in positions 3, 5 and 5,3. Thus 


a 

ff 
eoccr Fr 
oOo OF FR 
rrr OO 
PrPrF OO 
eee OO 


The reader may verify that W, = W, and thus 


(RU S)* = (C1, 1), 1,2), (2, 1), (2,2), B, 3), G, 4), G5), (4,3), 
(4,4), (4,5), (5, 3), (5,4), (5, 5)}. 


The corresponding partition of A is then (verify) {{1, 2}, (3,4, 5}}. a 
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EXERCISE SET 4.8 


1. 


2. 


5. 


(a) Let A = {1,2, 3} and let R = {(1, 1), (1,2), 
(2, 3), (1, 3), (3, 1), 3, 2)}. Compute the 
matrix M; of the transitive closure R by 
using the formula 

Maz = Mg V (Mg)3 V (Mp)3- 


(b) List the relation R® whose matrix was com- 
puted in part (a). 


For the relation R of Exercise 1, compute the 
transitive closure R* by using Warshall’s 
algorithm. 


Let A = {a), a5, 43, a4, as} and let R be a relation 
on A whose matrix is 


0 


Mz = 


OrPoor 
- OC 
cco eo 
ocr Oo Ff 


0 


Compute W,, W,, and W, as in Warshall’s algo- 
rithm. 


Find R” for the relation in Exercise 3. 


Prove that if R is reflexive and transitive, then 
R" = R for all n. 


Let R be a relation on a set A, and let S = R’. 
Prove that if a,b € A,then a S” b if and only if 
there is a path in R from a to b having an even 
number of edges. 


In Exercises 7 through 10, let A = {1,2,3, 4}. 
For the relation R whose matrix is given, find 
the matrix of the transitive closure by using 
Warshall’s algorithm. 


1001 
1100 
FR Nghe 4 26 
0001 
1100 
100 0 
& Melo 0 o 4 
001 0 


1001 
0110 
Pe ara 1) 
1001 
0001 
1001 
10Me=|5 4 9 4 
001 0 


In Exercises 11 and 12, let A = {1,2,3,4, 5} and 
let R and S be the equivalence relations on A 
whose matrices are given. Compute the matrix 
of the smallest equivalence relation containing 
Rand S, and list the elements of this relation. 


on. 1110 0 
1110 0 
M,=|1 1 1 0 0 
00011 
00011 
10000 
0.2 2.6 
M,=|0 1 1 1 0 
01110 
00001 
ie 10000 
01100 
Mg=|0 1 1 0 0 
00011 
00011 
11000 
1100 0 
Ms=|0 0 1 0 0 
0001 0 
00001 


13. Compute the partition of A that corresponds to 
the equivalence relation found in Exercise 11. 


14. Compute the partition of A that corresponds to 


the equivalence relation found in Exercise 12. 


15. Let A = {a, b,c, d, e} and let R and S be the 


relations on A described by 


1 
0 
Mz =| 1 
0 
1 


ooo cof 
ePrePoor 
ororo 
eceocorF 


KEY IDEAS FOR REVIEW 


¢ A xX B (product set or Cartesian product): 


fee ¢ 


+ 


{(a,b)|a€ Aandb € B} 

|A x B| = |A||B| 

Partition or quotient set: see page 103 
Relation from A to B: subset of A x B 
Domain and range of a relation: see page 109 
Relative sets R(a),ain A, and R(B), B a sub- 
set of A: see page 109 

Matrix of a relation: see page 111 

Digraph of a relation: pictorial representa- 
tion of a relation: see page 111 

Path of length n from a to b in a relation R: 
finite sequence a, x,,X5,...,X, 1, such that 
aARx,,x,RX,...,x,-,Rb 

x R” y (Ra relation on A): There is a path of 
length from x to yin R. 


# x R* y (connectivity relation for R): Some 


+ 


+ 


path exists in R from x to y. 

Theorem: Myr = Mp © M, © ---© Mg (x fac- 
tors) 

Properties of relations on a set A: 


Reflexive (a,a)E RforallaecA 

Irreflexive (a,a) € RforallacA 

Symmetric (a, b) © R implies that 
(b,ay)ER 

Asymmetric (a, b) © R implies that 
(ba) ER 

Antisymmetric (a,b) € Rand (b,a) ER 
imply that a = b 

Transitive (a,b) € Rand (b,c) ER 


imply that (a,c) ER 
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and 


0101 0 
11001 
M,=|1 1 1 0 0 
0910 0 0 
0101 0 


Use Warshall’s algorithm to compute the transitive 
closure of R U S. 


Graph of a symmetric relation: see page 127 
Adjacent vertices: see page 127 

Equivalence relation: reflexive, symmetric, 
and transitive relation. 

Equivalence relation determined by a parti- 
tion: see page 132 

Linked-list computer representation of a 
relation: see page 136 

a R b (complement of R): a R 6 if and only if 
aRb 


R™: (x, y) © R71 if and only if (y,x) E R 
RUS, RN S:see page 146 

Mans = Mp /\ Ms 

Maus = Me V Mg 

Mj- = (M,)” 

Mg = Mp 

If & and S are equivalence relations, so is 


R10 S: see page 150 

Ro S:see page 152 

Ms.2 = Mz © Mg: see page 153 

Theorem: R®* is the smallest transitive rela- 
tion on A that contains R: see page 157 
Theorem: If|A] =n, R® = RUR?U--UR" 
Warshall’s algorithm: computes Mg effi- 
ciently; see page 159 

Theorem: If R and S are equivalence rela- 
tions on A, (R U S)* is the smallest equiva- 
lence relation on A containing both A and B. 


166 Chapter 4 Relations and Digraphs 


CODING EXERCISES 


For each of the following, write the requested 
Program or subroutine in pseudocode (as 
described in Appendix A) or in a programming 
language that you know. Test your code either 
with a paper-and-pencil trace or with a comput- 
er run. 


1. Write a program CROSS with input positive 
integers m and n and output the set 
A X B, where A = {1, 2, 3,..., m} and 
B= {1,2,3,...,n}. 


2. (a) Write a subroutine that has as input the 
matrix of a relation and determines 
whether the relation is reflexive. 

(b) Write a subroutine that has as input the 
matrix of a relation and determines 
whether the relation is symmetric. 


3. Write a program that has as input the matrix 
of a relation and determines whether the 
relation is an equivalence relation. 


4. Let R and S$ be relations represented by 
matrices Mz and Mg, respectively. Write a 
subroutine to produce the matrix of 
(a) RUS. 

(b) RNS. 
(c) ReS. 


§. Let R be a relation represented by the 
matrix Mz. Write a subroutine to produce 
the matrix of 
(a) Ro. 

(b) R. 


Prerequisites: Chapter 4 


In this chapter we focus our attention on a special type of relation, a function, 
that plays an important role in mathematics, computer science, and many appli- 
cations. We also define some functions used in computer science and examine the 
growth of functions. 


5.1. Functions 


In this section we define the notion of a function, a special type of relation. We 
study its basic properties and then discuss several special types of functions. A 
number of important applications of functions will occur in later sections of the 
book, so it is essential to get a good grasp of the material in this section. 

Let A and B be nonempty sets. A function f from A to B, which is denoted 
f:A > B,isa relation from A to B such that for all a € Dom(f), f(a) contains 
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just one element of B. Naturally, if a is not in Dom(f), then f(a) = ©. If 
f(a) = {b}, it is traditional to identify the set (b} with the element b and write 
f(@) = 5. We will follow this custom, since no confusion results. The relation fcan 
then be described as the set of pairs {(a, f(a)) | a © Dom(f)}. Functions are also 
called mappings or transformations, since they can be geometrically viewed as 
rules that assign to each element a € A the unique element f(a) € B (see Figure 
5.1). The element a is called an argument of the function f, and f(a) is called the 
value of the function for the argument a and is also referred to as the image of a 
under f. Figure 5.1 is a schematic or pictorial display of our definition of a func- 
tion, and we will use several other similar diagrams. They should not be confused 
with the digraph of the relation f, which we will not generally display. 


b= f(a) 


Figure 5.1 
Example 1. Let A = {1,2,3,4) and B = {a, b,c, d}, and let 
f = {(1, 2), (2, a), (3, d), (4, c)}. 


Here we have 


fj) =a 
f2)=a 
fGR)=d 
f4=c. 


Since each set f(7) is a single value, fis a function. 

Note that the element « € B appears as the second element of two differ- 
ent ordered pairs in f. This does not conflict with the definition of a function. 
Thus a function may take the same value at two different elements of A. Sd 


Example 2. Let A = {1,2,3} and B = {x, y, z}. Consider the relations 
R= {(1,x),@,x)} and S = (x), (1, y), 2, 2), 3. y)}- 


The relation S is not a function since S(1) = {x, y}. The relation R is a function 
with Dom(R) = {1,2} and Ran(R) = {x}. A 


Example 3. Let P be a compu‘er program that accepts an integer as input and 
produces an integer as output. Let A = B = Z. Then P determines a relation fp 
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defined as follows: (m,n) © f, means that n is the output produced by program 
P when the input is m. 

It is clear that f, is a function, since any particular input corresponds to a 
unique output (computer results are reproducible; that is, they are the same each 
time the program is run). ° 


Example 3 can be generalized to a program with any set A of possible 
inputs and set B of corresponding outputs. In general, therefore, we may think of 
functions as input-output relations. 


Example 4. Let A = R be the set of all real numbers, and let p(x) = ay) + a,x + 
+++ + a,x" be a real polynomial. Then p may be viewed as a relation on A. For 
each a in R we determine the relative set p(a) by substituting a into the polyno- 
mial. Then, since all relative sets p(a) are known, the relation p is determined. 
Since a unique value is produced by this substitution, the relation p is actually a 
function. 5 


If the formula defining the function does not make sense for all elements of 
A, then the domain of the function is taken to be the set of elements of A for 
which the formula does make sense. 

In elementary mathematics, the formula (in the case of Example 4, the poly- 
nomial) is usually confused with the function it produces. This is not harmful, 
unless the student comes to expect a formula for every type of function. 

Suppose that, in the construction above, we used a formula that produced 
more than one element in p(x), for example, p(x) = +x. Then the resulting 
relation would not be a function. For this reason, in older texts, relations were 
sometimes called multiple-valued functions. 


Example 5. A labeled digraph is a digraph in which the vertices or the edges (or 
both) are labeled with information from a set. If V is the set of vertices and L is 
the set of labels of a labeled digraph, then the labeling of V can be specified to be 
a function f: V > L, where, for each v € V, f(v) is the label we wish to attach to 
v. Similarly, we can define a labeling of the edges E as a function g: E > L, where, 
for each e € E, g(e) is the label we wish to attach to e. An example of a labeled 
digraph is a map on which the vertices are labeled with the names of cities and 
the edges are labeled with the distances or travel times between the cities. 
Another example is a flow chart of a program in which the vertices are labeled 
with the steps that are to be performed at that point in the program; the edges 
indicate the flow from one part of the program to another part. Figure 5.2 shows 
an example of a labeled digraph. A 


Example 6. Let A = B = Zand let f: A > B be defined by 
f(a)=at+1, fora€a. 
Here, as in Example 4, fis defined by giving a formula for the values f(a). 


Example 7. Let A = Zand let B = {0, 1}. Let f: A > B be defined by 


0 if ais even 
fla) = {; if ais odd. 
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Then f is a function, since each set f(a) consists of a single element. Unlike the 
situation in Examples 4 and 6, the elements f(a) are not specified through an 
algebraic formula. Instead, a verbal description is given. 5 


Boston 


44 
Worcester 


49 


Providence 


dé 


Hartford 


39\ 


New Haven 
Figure 5.2 


Example 8. Let A be an arbitrary nonempty set. The identity function on A, 
denoted by 1,, is defined by 


1,(4) = a. oa 


The reader may notice that 1, is the relation we previously called A (see 
Section 4.4), which stands for the diagonal subset of A x A. In the context of 
functions, the notation 1, is preferred, since it emphasizes the input-output or 
functional nature of the relation. Clearly, if A, C A, then 1,(A,) = A,. Suppose 
that f: A > B and g: B > C are functions. Then the composition of f and g, g of 
(see Section 4.7), is a relation. Let a € Dom(g of). Then, by Theorem 6 of Section 
4.7, (ge f)(a) = g(f(a)). Since f and g are functions, f(a) consists of a single ele- 
ment b € B,so g(f(a)) = g(b). Since g is also a function, g(b) contains just one 
element of C. Thus each set (g ° f)(a), for a in Dom(g ¢ f), contains just one ele- 
ment of C,so go fis a function. This is illustrated diagrammatically in Figure 5.3. 


Example 9. Let A = B = Z,and C be the set of even integers. Let f: A > B and 
g: B > C be defined by 


f@a=atl1 
g(b) = 26. 


Find g of. 
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c= g(b) 
= (g0f)(a) 
C 


Figure 5.3 


Solution: We have 
(g ° f)(a) = g(f(@)) 
= g(a +1) 
= 2(a +1). 
Thus, if f and g are functions specified by giving formulas, then so is go f, 


and the formula for g o fis produced by substituting the formula for f into 
the formula for g. a 


Special Types of Functions 


Let f be a function from A to B. Then we say that f is everywhere defined if 
Dom(f) = A. We say that f is onto if Ran(f) = B. Finally, we say that fi is one to 
one if we cannot have f(a) = f(a’) for two distinct elements a and a’ of A. The 
definition of one to one may be restated in the following equivalent form: 


If f(a) = f(a’), thena=a’. 
The latter form is often easier to verify in particular examples. 


Example 10. Consider the function f defined in Example 1. Since Dom(f) = 
f is everywhere defined. On the other hand, Ran(f) = {a, c, d} # B; therefore, f 
is not onto, Since 
FQ) = fQ) = a, 
we can conclude that f is not one to one. Sd 


Example 11. Consider the function f defined in Example 6. Which of the spe- 
cial properties above, if any, does f possess? 
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Solution: Since the formula defining f makes sense for all integers, 
Dom(f) = Z = A, and so fis everywhere defined. 
Suppose that 


f@=f@) 
for a and a’ in A. Then 
at+1l=a’+1 


so 


Hence f is one to one. 
To see if fis onto, let b be an arbitrary element of B. Can we find an ele- 
ment a € A such that f(a) = b? 


Since 
f@=atl, 

we need an element a in A such that 

a+1=b. 
Of course, 

a=b-1 
will satisfy the desired equation since b — 1 is in A. Hence Ran(f) = B; 
therefore, f is onto. Sd 


Example 12. Let A = {a,, a, a3), B = {b,, b,, bs}, C = {c,, c}, and D = 
{d,, a, d,, d,}. Consider the following four functions, from A to B, A to D, B to C, 
and D to B, respectively. 

(a) f, = (a, b2), (ay, bs), (43, By)}- 

(b) f, = {(4, 2), (@, 4), (as. d,)}. 

(c) f, 7 (OG, C2), (bo, C2), (bs, c;) }. 

(d) fy = (dy, 51), (dy, 2), (ds, 9}. 

Determine whether or not each function is one to one, whether each function is 
onto, and whether each function is everywhere defined. 


Solution 

(a) f, is everywhere defined, one to one, and onto. 

(b) f, is everywhere defined and one to one, but not onto. 

(c) jf; is everywhere defined and onto, but is not one to one. 

(d) jf, is not everywhere defined, not one to one, and not onto. ¢ 


If f: A — Bisa one-to-one function, then f associates to each element a of 
Dom(f) an element b = f(a) of Ran(f). Every b in Ran(f) is matched, in this 
way, with one and only one element of Dom(f). For this reason, such an fis often 
called a bijection between Domn(f) and Ran(f). If f is also everywhere defined 
and onto, then fis called a one-to-one correspondence between A and B. 
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Example 13. Let & be the set of all equivalence relations on a given set A, and 
let I] be the set of all partitions on A. Then we can define a function f: # —> Il as 
follows. For each equivalence relation R on A, let f(R) = A/R, the partition of A 
that corresponds to R. The discussion in Section 4.5 shows that fis a one-to-one 
correspondence between & and I]. ¢ 


Invertible Functions 


A function f: A > B is said to be invertible if its inverse relation, f~', is also a 
function. The next example shows that a function is not necessarily invertible. 


Example 14. Let f be the function of Example 1. Then 
f* = {(a,1), @, 2), 4,3), (c, 4}. 


We see that f! is not a function, since f" (a) = {1,2}. ° 
The following theorem is frequently used. 


Theorem 1. Let f:A— B bea function. 
(a) Then f' is a function from B to A if and only if f is one to one. 
(b) Iff7! is a function, then the function f~ is also one to one. 
(c) f71 is everywhere defined if and only if f is onto. 
(d) f7! is onto if and only if f is everywhere defined. 


Proof: (a) We prove the following equivalent statement. 
f7' is not a function if and only if f is not one to one. 


Suppose first that f~+ is not a function. Then, for some b in B, f(b) must 
contain at least two distinct elements, a, and a,. Then f(a,) = 6 = f(a@,),sof 
is not one to one. 

Conversely, suppose that f is not one to one. Then f(a,) = f(a.) = 6 for 
two distinct elements a, and a, of A. Thus f~!(b) contains both a, and a, so 
f7~' cannot be a function. 

(b) Since (f~')7! is the function f, part (a) shows that f~! is one to one. 

(c) Recall that Dom(f~!) = Ran(f). Thus B = Dom(f~') if and only if 
B = Ran(f). In other words, f~! is everywhere defined if and only if f is 
onto. 

(d) Since Ran(f~') = Dom(f), A = Dom(f) if and only if A = 
Ran(f~'). That is, fis everywhere defined if and only if f~' is onto. o 


As an immediate consequence of Theorem 1, we see that if fis a one-to-one 
correspondence between A and B, then f~' is a one-to-one correspondence 
between B and A. Note also that if f: A > B is a one-to-one function, then the 
equation b = f(a) is equivalent to a = f~1(b). 


Example 15. Consider the function f defined in Example 6. Since f is every- 
where defined, one to one, and onto, it is a one-to-one correspondence between 
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A and B. Thus f is invertible, and f~! is a one-to-one correspondence between B 
and A. e 


Example 16. Let R be the set of real numbers, and let f: R > R be defined by 
f(x) = x7. Is f invertible? 


Solution: We must deterinine whether f is one to one. Since 
FZ) ={[e2) > 4 


we conclude that fis not one to one. Hence fis not invertible. Sd 


There are some useful results concerning the composition of functions. We 
summarize these in the following theorem. 


Theorem 2. Let f:A — B be any function. Then 
(a) lnpef=f 
(b) fola=f. 


If f is a one-to-one corresponderice between A and B, then 


(c) flof=1,. 
(d) fof =I, 
Proof: (a) (1g° f)(a) = 1g(f(a)) = f(a), for all a in Dom(f). Thus, by 
Theorem 2 of Section 4.2, 1, of =f. 
(b) (fe 14) (@) = f(L4(@)) = f(@), for all a in Dom(f), so fe 1, =f. 
Suppose now that fis a one-to-one correspondence between A and B. As 
we pointed out above, the equation b = f(a) is equivalent to the equation 
a = f-(b). Since f and f~' are both everywhere defined and onto, this 
means that, for allain A and bin B, f(f~' (6)) = band f~'(f(a)) = a. Then 
(c) For alla in A,1,(a) = a =f~' (f(@) = (fe f)(@). Thus 1, = fof. 
(d) For all bin B,1,(b) = b = f(f-"\(6)) = (fo f')(B). Thus 1, = fof. 
e 


Theorem 3. (a) Letf:A— Band g:B—-A be functions such that go f = 1,4 
and f ° g = 1,. Then f is a one-to-one correspondence between A and B, g is a one- 
to-one correspondence between 8 and A, and each is the inverse of the other. 
(b) Letf:A > Band g:B-C be invertible. Then g of is invertible, and 
CS at ae ee 
Proof: (a) The assumptions mean that 
e(f(a)) =a and f(g(b)) = 4, forallain A and b in B. 


This shows in particular that Ran(f) = B and Ran(g) = A,so each function 
is onto. If f(a,) = f(a), then a, = g(f(a,)) = g(f(a@)) = a). Thus f is one to 
one. In a similar way, we see that g is one to one, so both f and g are invert- 
ible. Note that f~! is everywhere defined since Dom(f~') = Ran(f) = B. 
Now, if b is any element in B, 


f(b) = FFD) = (Fo f(B(b)) = 14(e(0)) = 8(6). 
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Thus g = f~', so also f = (f7')! = g™!. Then, since g and f are onto, f™ 
and g™' are onto, so f and g must be everywhere defined. This proves all 
parts of part (a). 

(b) We know that (g 0 f)7! = f7!o g™!, since this is true for any relations. 
Since g™! and f~! are functions by assumption, so is their composition, and 
then (g ° f)”/ is a function. Thus g  f is invertible. eo 


Example 17. Let A = B =R, the set of real numbers. Let f: A — B be given by 
the formula 


fa) = 28-1 


gly) = \/ 7 + > 


Show that fis a bijection between A and B and g is a bijection between B and A. 
Solution: Letx © Aandy = f(x) = 2x? — 1.Then3(y + 1) = x°; therefore, 


x=Way +d = aly) = e(f(x)) = (ee f)(x). Thus ge f = 1,, Similarly, 
fog = 1,,s0 by Theorem 3(a) both f and g are bijections. So 


and let g: B > A be given by 


As Example 17 shows, it is often easier to show that a function, such as f, is 
one to one and onto by constructing an inverse instead of proceeding directly. 

Finally, we discuss briefly some special results that hold when A and B are 
finite sets. Let A = {a,,...,a,} and B = {b,,...,5,}, and let f be a function from 
A to B that is everywhere defined. If f is one to one, then f(a;), f(a),..., f(a@,) 
are n distinct elements of B. Thus we must have all of B, so f is also onto, On the 
other hand, if fis onto, then f(a,),..., f(a,,) form the entire set B, so they must all 
be different. Hence fis also one to one. We have therefore shown the following: 


Theorem 4. Let A and B be two finite sets with the same number of elements, and 
let f: A > B be an everywhere defined function. 

(a) If fis one to one, then f is onto. 

(b) If fis onto, then f is one to one. Sd 


Thus for finite sets A and B with the same number of elements, and particularly 
if A = B, we need only prove that a function is one to one or onto to show that 
it is a bijection. 


EXERCISE SET 5.1 


1. Let A = {a, b, c,d) and B = {1,2, 3}. Determine 2. Determine whether the relation R from A to B 
whether the relation R from A to B is a func- is a function. 


tion. [f it is a function, give its range. 

(a) R = {(a, 1), (b, 2), (c, 1), (4, 2)} 

(b) R= {(a, 1), (6, 2), (4,2), (c, 1), (4, 2)} 
(4,3), (6, 2), (ce, 1)} number. 

(a, 1), (B, 1), (e, 1), (d, 1)} (b) A = aset of people in the United States, 


(c) R 
(d) R 


{ 
{ 
{ 


(a) A = the set of all recipients of Medicare in 
the United States, B = {x | x is a nine-digit 
number}, a R b if b is a’s Social Security 
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B = {x | xis. a nine-digit number}, a R b if b 
is a’s passport number. 


In Exercises 3 through 6, verify that the formula 
yields a function from A to B. 


3.A=B=Z;f(a)=a@’ 
4.A=B=R f(a) =e 


5. A = R, B= {0,1}; let Z be the set of integers 
and note that Z C R. Then for any real number 


a, let 
_f{0 ifa€Z 
pay={' ifaeZ. 


6. A = R, B = Z; f(a) = the greatest integer less 
than or equal to a 


7. LetA = B=C=R,and let f:A — B, 
g:B-— C be defined by f(a) = a-1 and 
g(b) = b?. Find 
(a) (fes)@2) — (b) (ge f)Q2) 

(c) (gef)(x) — (d) (fe g)@) 
) Fe) W& ea) 


8 LetA = B=C=R,andletf:A —> B, 
g:B- Cbe defined by f(a) = a + 1 and 
g(b) = b? + 2. Find 
(a) (g°f)(-2) — (b) (feg)(-2) 

(c) (g ef )(x) (d) (fe g)(x) 
(e) (Fe f)O) (f) (g°g)0) 


9. In each part, sets A and B and a function from 
A to B are given. Determine whether the func- 
tion is one to one or onto (or both or neither). 
(a) A = (1,2, 3,4} = B; 

f= {0,1), 2,3), 8,4), 4,2)} 
(b) A= (1,2,3) B= (a,b,c, d}; 
f= {C1 a), 2, a), 3,6) 


(c) A={3.5.4hB = (592 wh 


= (Gx), G.»).6.»)} 
(d) A = {1.1,7, 0.06}; B = (p, q}: 
f= {(.1, p), (7, q), (0.06, p)} 
(e) A= B=Z,f(a)=a-1 


10. 


11. 


12. 


Let f be a function from A to B. Determine 
whether each function fis one to one and 
whether it is onto. 
(a) A=R,B = (x| x is real and x = 0}; f(a) = a} 
(b) A=RXR,B=R,; f((a,5)) =a 
(c) Let S = (1,2, 3}, T = {a,b}. LetA = B= 
S X Tand let f be defined by f(a, a) = (n, 6), 
n= 1,2,3,and f(a, 6) = (1,4), = 1,2,3. 
(4d) A=B=RXR;f((a,b)) = (a+ b,a—-b) 
(ec) A = R, B= {x| x is real and x = 0}; f(a) = a? 


Let f: A -> Band g: B > A. Verify that g = fo. 
(a) A = B= RB; f(a) = *3+, 8() = 2-1 
(b) A = {x| xis real and x = 0}; B = {y|y is 
real and y = —1}; f(a) = a? - 1, 
g(b)= Vb +1 
(c) A = B = P(S), where S is a set. If 
X & P(S), let f(X) = X = g(X). 
(d) A = B= {1,2,3, 4}; f = {C1 4), (2, 1), (3,2), 
(4, 3)}ig = {(1,2), (2,3), 3,4), (4, 1) 


Let f be a function from A to B. Find f~. 
(a) A = {x|x is real and x = —1}; B= 

{x | xis real and x = 0}; f(a) = Va + 1 
(b) A= B=Rf(a)=a +1 
(c) A= B=R f(a) = 4+ 
(d) A= B= {1,2,3,4,5}: 

f= {(1, 3), 2, 2), G, 4), (4,5), (S, D} 


In Exercises 13 and 14, let f be a function from 
A = {1,2,3, 4} to B = {a, b,c, d}. Determine 
whether f~' is a function. 


13. 


14. 


15. 


16. 


17. 


f= (C4), 2.4), 3,0), (4,0) 
f= {(.4), (2, ¢), (3, 6), 4, 4)} 


Let A = B = C = R and consider the functions 
f:A-— Bandg:B- C defined by f(a) = 

2a + 1, g(b) = b/3. Verify Theorem 3(b): 
(gofy'=fiteg?. 


If aset A has n elements, how many functions 
are there from A to A? 


Ifa set A has n elements, how many bijections 
are there from A to A? 


18. 


19. 


20. 


21. 


22. 


23. 


Let f:A - Band g: B - C be functions. Show 
that if go f is onto, then g is onto. 
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If A has m elements and B has n elements, how (k factors), and let f~* = fol ofl o++-of7t 
many functions are there from A to B? (k factors). Define f° to be 1,. Then f” is defined 
for all n © Z. For any a € A, let 
ssiee ; O(a f) = {f"(a@) |n & Z}. Prove that if a,, 
oinmuideng acnirne |  eeBE CCL) OL) aithen 
Nyy Ola,.f) = O(e.f). 
Prove that if f: A- Band g: B- Care onto 24, Let f:A — B be a function with finite domain 
functions, then g o fis onto. and range. Suppose that |Dom(f)| = n and 
|Ran(f)| = m, Prove that: 
(a) If fis one to one, then m =n. 
Let f:A > Band g: B > C be functions. Show (b) If fis not one to one, then m <n. 


that if go f is one to one, then fis one to one. 


25. Let |A| =|B| = and let f: A> B be an 
everywhere defined function. Prove that the 
following three statements are equivalent. 
(a) fis one to one. 

(b) fis onto. 


Let A be a set, and let f: A > A be a bijection. (c) fis a one-to-one correspondence (that is, f 
For any integer k = 1, let f* = fofo---of is one to one and onto). 


5.2. Functions for Computer Science 


In previous chapters, we introduced on an informal basis some functions com- 
monly used in computer science applications. In this section we review these and 
define some others. 


Example 1. Let A be a subset of the universal set U = {u,, uw), u3,...,u,,}. The 
characteristic function of A is defined as a function from U to {0, 1} by the fol- 
lowing: 

1 ifu,;E A 
fale) = {6 itu, A. 


If A = {4,7,9) and U = {1,2,3,..., 10}, then £,(2) = 0, f,(4) = 1, £,(7) = 1, and 
f,(12) is undefined. It is easy to check that f, is everywhere defined and onto, but 
is not one to one. Sa 


Example 2. In Section 1.4 we defined a family of mod functions, one for each 
positive integer n. Each f, is a function from the nonnegative integers to the set 
{0,1,2,3,...,2 — 1). For a fixed n, any nonnegative integer z can be written as 
Z=kn+rwithO =r <n.Then f(z) = r. We can also express this relation as 
z =r(mod n). Each member of the mod function family is everywhere defined 
and onto, but not one to one. . 4 


Example 3. Let A be the set of nonnegative integers, B = Z*, and let f:A > B 
be defined by f(n) = nl. Sd 
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Example 4. The general version of the pigeonhole principle (Section 3.3) 
required the floor function, which is defined for rational numbers as f(q) is the 
largest integer less than or equal to g. Here again is an example of a function that 
is not defined by a formula. Thus 


fasy=Lisl=1,  f(-3)=L-3}= -3. ° 


Example 5. A function similar to that in Example 4 is the ceiling function, 
which is defined for rational nurnbers as c(q) is the smallest integer greater than 
or equal to q. The notation [| is also used for c(q). Thus 


c(1.5)=[1.5]=2,  c(—3) =[-3] = -3. o 


Many common algebraic functions are used in computer science, often with 
domains restricted to subsets of the integers. 


Example 6 
(a) Any polynomial with integer coefficients, p,can be used to define a function 
on Z as follows: If p(x) = a) + a,x + ayx* +--+ + a,x" and 


z & Z, then f(z) is the value of p evaluated at z. 
(b) Let A = B = Z* and let f: A — B be defined by f(z) = 27. We call f the base 
2 exponential function. Other bases may be used to define similar functions. 
(c) Let A = B = R and let f,,: A > B be defined for each positive integer n > 1 
as f,(x) = log,,(x), the logarithm to the base x of x. In computer science appli- 
cations, the bases 2 and 10 are particularly useful. Sd 


In general, the unary operations discussed in previous sections can be used 
to create functions similar to the function in Example 3. The sets A and B in the 
definition of a function need not be sets of numbers, as seen in the following 
examples. 


Example 7 

(a) Let A be a finite set and detine /: A* > Z as I(w) is the length of the string 
w (see Section 1.3 for the definition of A* and strings). 

(b) Let B be a finite subset of the universal set U and define pow(B) to be the 
power set of B. Then pow is a function from V, the power set of U, to the 
power set of V. 

(c) Let A = B = the set of al. 2 x 2 matrices with real number entries and let 
t(M) = M’, the transpose of M. Then r is everywhere defined, onto, and one 
to one. Sd 


Binary operations can also be used to define functions. In this case the func- 
tion defined will have ordered pairs as input. 


Example 8 

(a) For elements of Z* X Z*, define g(z,, z,) to be GCD(z,, z,). Then g is a func- 
tion from Z* x Z* to Z*. The GCD of two numbers is defined in Section 1.4. 

(b) In a similar fashion we can define m(z,, z,) to be LCM(z,, z,). Sa 


Another type of function, a Boolean function, plays a key role in nearly all 
computer programs. Let B = {true, false]. Then a function from a set A to B is 
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called a Boolean function. The predicates in Section 2.1 are examples of Boolean 
functions. 


Example 9. Let P(x): x is even and Q(y): y is odd. Then P(4) is true and Q(4) 
is false. The predicate R(x, y): x is even or y is odd is a Boolean function with two 
variables. Here R(3, 4) is false and R(6, 4) is true. 5 


Hashing Functions 


In Section 4.6, two methods of storing the data for a relation or digraph in a com- 
puter were presented. Here we consider a more general problem of storing data. 
Suppose that we must store and later examine a large number of data records, 
customer accounts for example. In general, we do not know how many records 
we may have to store at any given time. This suggests that linked-list storage is 
appropriate, because storage space is only used when we assign a record to it and 
we are not holding idle storage space. To examine a record, we will have to be 
able to find it; so storing the data in a single linked list is not practical because 
looking for an item may take a very long time (relatively speaking). One tech- 
nique for handling such storage problems is to create a number of linked lists and 
to provide a method of deciding onto which list a new item should be linked. This 
method will also determine which list to search for a desired item. A key point is 
to attempt to assign an item to one of the lists at random. (Remember from 
Section 3.4 that this means each list has an equal chance of being selected.) This 
will have the effect of making the lists roughly the same size and thus keep the 
searching time about the same for any item. 

Suppose that we must maintain the customer records for a large company 
and will store the information as computer records. We begin by assigning each 
customer a unique 7-digit account number. A unique identifier for a record is 
called its key. For now we will not consider exactly how and what information 
will be stored for each customer account, but will describe only the storage of a 
location in the computer’s memory where this information will be found. To 
determine to which list a particular record should be assigned, we create a hash- 
ing function from the set of keys to the set of list numbers. Hashing functions fre- 
quently use a mod function, as shown in the next example. 


Example 10. Suppose that (approximately) 10,000 customer account records 
must be stored and processed. The company’s computer is capable of searching 
a list of 100 items in an acceptable amount of time. We decide to create 101 linked 
lists for storage, because if the hashing function works well in “randomly” 
assigning records to lists, we would expect to see roughly 100 records per list. 
We define a hashing function from the set of 7-digit account numbers to the set 
{0, 1,2,3,..., 100} as follows: 


A(n) = n(mod 101). 
Thus, 


(2473871) = 2473871(mod 101) 
= 78. 
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This means that the record with account number 2473871 will be assigned to list 
78. Note that the range of is the set {0,1,2,..., 100}. Sa 


Because the function / in Example 10 is not one to one, different account 
numbers may be assigned to the same list by the hashing function. If the first 
position on list 78 is already occupied when the record with key 2473871 is to be 
stored, we say a collision has occurred. There are many methods for resolving col- 
lisions. One very simple method that will be sufficient for our work is to insert the 
new record at the end of the existing list. Using this method, when we wish to find 
a record, its key will be hashed and the list (key) will be searched sequentially. 

Many other hashing functions are suitable for this situation. For example, 
we may break the 7-digit account number into a 3-digit number and a 4-digit 
number, add these, and then apply the mod 101 function. Many factors are con- 
sidered in addition to the number of records to be stored; the speed with which 
an average-length list can be searched and the time needed to compute the list 
number for an account are two possible factors to be taken into account. For rea- 
sons that will not be discussed here, the modulus used in the mod function should 
be a prime. Determining a good hashing function for a particular application is a 
challenging task. 


EXERCISE SET 5.2 


1. Let f be the mod 10 function. Compute 


In Exercises 7 and 8, compute the values indi- 


(a) f(417) (b) (38) (c) (253) cated. Note that if the domain of these functions 
is Z*, then each function is the explicit formula 
2. Let f be the mod 7 function. Compute for an infinite sequence. Thus sequences can be 
(a) (81) (b) f(G316) (ec) f(1057) viewed as a special type of function. 
In Exercises 3 and 4, use the universal set 7. fin) =3n2-1 (a) f(3) (b) £7) 
U = {a,b,c,...,y, z} and the characteristic (c) f) (a) f(12) 
function for the subset to compute the 
requested function values. 8. etn) - 2n 4 os ao (b) g(14) 
Cc) 8 
3. A = {a, e, i, 0, uy (a) f,@ (b) fa) 2 
(c) falo) 9, Let f,(n) = 2”. Compute each of the following: 
ee ee ane ee @Ad ®f3) ©Of6) @ f£00 
. = »,0,P,qd,7, BAG 
{b) f(r) (c) f,(s) 10. Let f,(n) = 3”. Compute each of the following: 
5. Compute each of the following: oe ee) Ce! ee 
(a) 2.78] (b) L-2.78] (ce) L14] 
(d) L-173)  (e) L2ts] In Exercises 11 and 12, let lg(x) = log,(x). 
6. Compute each of the following: 11. Compute each of the following: 
(a) [2.781 (b) [-2.781 (ce) [14] (a) Ig(16) — (b) fg(128) (ce) Ig(512) 
(d)[-17.31 Ce) [21.5] (d) #g(1024) 


12. For each of the following, find the largest inte- 
ger less than or equal to the function value and 
the smallest integer greater than or equal to the 
function value. 

(a) Ig(10) —(b) /g(25) 
(d) #g(100) — (e) Ig(256) 


{c) 1g(50) 


13, Prove that the function tin Example 7(c) that 
maps the set of 5 X 5 matrices to itself is every- 


where defined, onto, and one to one. 


+ 


14, Let A = (a, b,c, d}. For the function / in 
Example 7(a), 
(a) prove that / is everywhere defined. 
(b) prove that / is not one to one. 
(c) prove or disprove that / is onto. 


15. Let A be a set with n elements, S be the set of 
relations on A, and M the set of n X n Boolean 
matrices. Define f: S + M by f(R) = Mg. Prove 
that fis a bijection between S and M. 


16. Let P be the propositional function defined by 
P(x, y) = (x Vy) A ~ y. Evaluate each of the 
following: 

(a) P(true, true) 
(c) P(true, false) 


(b) P(false, true) 


5.3. Permutation Functions 
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17. Let G be the propositional function defined by 
Q(x): 3 (y € Z*) (xy = 60). Evaluate each of 
the following. 

(a) O(3) = (b) Q(7) 
(d) Q(15) 


(©) Q(-6) 


In Exercises 18 through 20, use the hashing 
function h, which takes the first three digits of 
the account number as one number and the last 
four digits as another number, adds them, and 
then applies the mod S9 function. 


18. Assume that there are 7500 customer records 
to be stored using this hashing function. 
(a) How many linked lists will be required for 
the storage of these records? 
(b) If an approximately even distribution is 
achieved, roughly how many records will be 
stored by each linked list? 


19. Determine to which list the given customer 
account should be attached. 
(a) 3759273 (b) 7149021 (c) 5167249 

20. Determine which list to search to find the given 
customer account. 


(a) 2561384 (b) 6082376 (c) 4984620 


In this section we discuss bijections from a set A to itself. Of special importance 
is the case when A is finite. Bijections on a finite set occur in a wide variety of 
applications in mathematics, computer science, and physics. 

A bijection from a set A to itself is called a permutation of A. 


Example 1. Let A = Rand let f: A — A be defined by f(a) = 2a + 1. Since fis 
one to one and onto (verify), it follows that f is a permutation of A. ¢ 


I£A = {a,,a),...,a,} is a finite set and p is a bijection on A, we list the ele- 
ments of A and the corresponding function values p(a,), p(a)),..., p(a,,) in the 


following form: 


ad ay <ebGo) 


a, tae a 


() 
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Observe that (1) completely describes p since it gives the value of p for every ele- 
ment of A. We often write 


ne ( ay a oct @, 

Pla) Paz) +°* Pla,) 
Thus, if p is a permutatior. of a finite set A = {a,, a),...,a,,}, then the 
sequence p(a)), p(a),..., p(a,,) is just a rearrangement of the elements of A and 


so corresponds exactly to a permutation of A in the sense of Section 3.1. 


Example 2. Let A = {1,2, 3}. Then all the permutations of A are 


3 Lee SB hos & 
Og AR Bs ate PERN a tap 
ft 23 Sh aes sii Be 
Be No i, WP PRONG. ape ES hae gy + 
Example 3. Using the permutations of Example 2, compute (a) p,'; (b) ps ° py 
Solution: (a) Viewing p, as a function, we have 
Py = {d, 3), (2, 1), (3, 2)). 
Then 
pa! = (3,1), (1,2), 2,3) 


or, when written in increasing order of the first component of each ordered 
pair, we have 


pa! = {(1, 2), (2,3), 3, D}. 
Thus 


(b) The function p, takes 1 to 2 and p; takes 2 to 3, so p, ° py takes 1 
to 3. Also, p, takes 2 to 1 and p, takes 1 to 2, so p, © p, takes 2 to 2. Finally, 
P2 takes 3 to 3 and p; takes 3 to 1, so p; © p, takes 3 to 1. Thus 


1 2 3 
3° Pa = \4 a4) 


We may view the process of forming p, o p, as shown in Figure 5.4, Observe 
that p ° py = Ds. . 


The composition of two permutations is another permutation, usually 
referred to as the product of these permutations. In the remainder of this chap- 
ter, we will follow this convention 


Theorem 1. [fA = {a,,a),...,a,} is a set containing n elements, then there are 
n$=n-(n—1)---2+1 permutations of A. 
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Proof: This result follows from Theorem 4 of Section 3.1 by letting 
r=n. ¢ 


1 2 3 ] 2 3 
P3 op, = = 
2 1 3 G) 2 1 
Figure 5.4 
Let b,, b,,..., b, be r distinct elements of the set A = {a,,@,...,a,). The 
permutation p : A — A defined by 

p(b,) = b, 
P(b2) = bs 
p(b,-1) = b, 
p(b,) = by 


P(x) = x, ifx EA, x € {b,,by,...,6,}. 


is called a cyclic permutation of length r, or simply a cycle of length r, and will be 
denoted by (b,, b,,..., b,). Do not confuse this terminology with that used for 
cycles in a digraph (Section 4.3). The two concepts are different and we use slight- 
ly different notations. If the elements b,, by,...,b, are arranged uniformly on a 
circle, as shown in Figure 5.5, then a cycle p of length r moves these elements in 
a clockwise direction so that 5, is sent to b,, b, to b;,...,b, _, to b,, and 6, to b,. 
All the other elements of A are left fixed by p. 


by 


by 


byt 


Figure 5.5 
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Example 4. Let A = {1,2,3, 4, 5}. The cycle (1,3, 5) denotes the permutation 


Ae 22.3. AS 
; a 
( 2Y Spo 4 ; 
Observe that if p = (6,,0.,...,6,) is a cycle of length r, then we can also 


write p by starting with any b,,1 =i =r, and moving in a clockwise direction, as 
shown in Figure 5.5. Thus, as cycles, 


(3,5, 8,2) = (5,3, 2,3) = (8,2,3, 5) = (2,3,5,8). 


Note also that the notatior. for a cycle does not indicate the number of ele- 
ments in the set A. Thus the cycle (3, 2, 1, 4) could be a permutation of the set 
{1, 2, 3, 4} or of {1, 2, 3, 4, 5, 6, 7. 8}. We need to be told explicitly the set on which 
a cycle is defined. It follows from the definition that a cycle on a set A is of length 
1 if and only if it is the identity permutation, 1,. 

Since cycles are permutations, we can form their product. However, as we 
show in the following example, the product of two cycles need not be a cycle. 


Example 5. Let A = {1, 2, 3, 4, 5, 6}. Compute (4, 1, 3, 5) o (5, 6, 3) and 
(5, 6, 3) o (4, 1, 3, 5). 


Solution: We have 


igi Be Bi AES 16 
@1as-(, a3 4 A ‘| 
and 
Feo ple Oe BP chen 5. 6 
6.6.3 =(1 15 4 6 ) 
Then 
123 4 5 6 fi 23 4 5 6 
3,5) = a 
(4, 1,3, 5) © 5, 6, 3) i a ee tae | | ‘i 2. Gm BiG ; 
Ah 2: AS 
3.241 6 5 
and 
123 4 5 6\ f1 2 3 5 6 
6.6.3) 64.13.9 =[] 2 5 4 6 }e( 25 1 4 3 
as. “2 BS Ae 5 6 
Se 2D) Be Shs BP 


Observe that 
(4,1, 3, 5) © (5,6, 3) # (5, 6,3) o (4, 1,3, 5) 


and that neither product is a. cycle. o 
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Two cycles of a set A are Said to be disjoint if no element of A appears in 
both cycles. 


Example 6. Let A = {1,2,3,4,5,6}. Then the cycles (1,2, 5) and (3, 4, 6) are dis- 
joint, whereas the cycles (1, 2,5) and (2, 4, 6) are not. Sd 


It is not difficult to show that if p, = (a,,a),...,a,) and p, = (bj, b,...,5,) 
are disjoint cycles of A, then p, ° p, = p, ° p;. This can be seen by observing that 
Pp, affects only the a’s, while p, affects only the b’s. 

We shall now present a fundamental theorem and, instead of giving its 
proof, we shall give an example that imitates the proof. 


Theorem 2. A permutation of a finite set that is not the identity or a cycle can be 
written as a product of disjoint cycles of length = 2. 


Example 7. Write the permutation 


_f1 2345678 
cae \ mer eae ef a a 


of the set A = {1,2,3, 4,5, 6, 7, 8} as a product of disjoint cycles. 


Solution: We start with 1 and find that p(1) = 3, p(3) = 6, and p(6) = 1,s0 
we have the cycle (1,3, 6). Next we choose the first element of A that has 
not appeared in a previous cycle. We choose 2, and we have p(2) = 4, 
p(4) = 5,and p(5) = 2,s0 we obtain the cycle (2, 4,5). We now choose 7, the 
first element of A that has not appeared in a previous cycle. Since p(7) = 8 
and p(8) = 7, we obtain the cycle (7,8). We can then write p as a product of 
disjoint cycles as 


p = (7,8) o (2, 4,5) © (1,3, 6). o 
It is not difficult to show that in Theorem 2, when a permutation is written 


as a product of disjoint cycles, the product is unique except for the order of the 
cycles, 


Even and Odd Permutations 


A cycle of length 2 is called a transposition. That is, a transposition is a cycle 
p = (4;,a;), where p(a;) = a, and p(a;) = a;. 

Observe that if p = (a;,a;) is a transposition of A, then po p = 1,, the iden- 
tity permutation of A. 

Every cycle can be written as a product of transpositions. In fact, 


(bj, Boy... 4B.) = (b1,b,) 2 (By, 6,-1) 9 ++ 2 (By, 83) © (By, 82). 
This can be verified by induction on r, as follows: 


Basis Step. If r = 2, then the cycle is just (b,, b,), which already has the proper 
form. 


186 


Chapter5 Functions 


INDUCTION Step. If the result is true for k, let (6), by,...,5,, 6,4 1) be a cycle of 
length & + 1.Then (5, B),..., By, Bg as) = (01, By 41) 2 (Dy, By, ..., By), aS May 
be verified by computing the composition. By the induction assumption, 
(B,, by, ..., by) = (b,, 6,) © (by, by) 9 +++ © (By, by). Thus, by substitution, 
(81, Bo, - +5 Bg) = (By, On 41) 2 (Oy, Bg) 2 +++ © (by, B3) © (6), bz). This completes 
the induction step. Thus, by the principle of mathematical induction, the result 
holds for every cycle. For exarple, 


(1, 2,3, 4,5) = (1,5) ° (1, 4) ¢ Cd, 3) o (1, 2). 
We now obtain the following corollary of Theorem 2. 


Corollary 1. Every permutation of a finite set with at least two elements can be 
written as a product of transpositions. a 


Observe that the transpositions in Corollary 1 need not be disjoint. 


Example 8. Write the permutation p of Example 7 as a product of transpositions. 
Solution: We have 
p = (7,8) 0 (2,4,5) © (1,3, 6). 
Since we can write 
(1.3, 6) = (1,6) o (1,3) 
(2,4, 5) = (2,5) o (2,4), 
we have 


p = (7,8) < (2,5) (2,4) 0 (1,6) ° (1,3). ° 


We have observed that every cycle can be written as a product of transpo- 
sitions. However, this can be dor.e in many different ways. For example, 


(1,2, 3) = (1,3) © (1,2) 
= (2,1) ¢ (2,3) 
= (1,3) © (3.1) 0 (1,3) © (1,2) o (3,2) © (2,3). 


It then follows that every permutation on a set of two or more elements can be 
written as a product of transpositions in many ways. However, the following the- 
orem, whose proof we omit, brings some order to the situation. 


Theorem 3. /f a permutation of a finite set can be written as a product of an even 
number of transpositions, then it can never be written as a product of an odd num- 
ber of transpositions, and conversely. Sd 


A permutation of a finite set is called even if it can be written as a product 
of an even number of transpositions, and it is called odd if it can be written as a 
product of an odd number of transpositions. 
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Example 9. Is the permutation 
_fi 2.3 4 5 6 7 
BONIS Be ESE. Bi 


Solution: We first write p as a product of disjoint cycles, obtaining 
p = (3,5, 6) o (1,2, 4,7). 
Next we write each of the cycles as a product of transpositions: 
(1, 2, 4,7) = (1,7) © (1,4) ¢ (1, 2) 
(3, 5, 6) = (3, 6) © (3, 5). 


even or odd? 


Then 
p = (3,6) ° (3,5) 1,7) 0,4) 2 (1, 2). 
Since p is a product of an odd number of transpositions, it is an odd per- 


mutation. 4 


From the definition of even and odd permutations, it follows (Exercise 14) 
that 

(a) The product of two even permutations is even. 

(b) The product of two odd permutations is even. 

(c) The product of an even and an odd permutation is odd. 


Theorem 4, Let A = {a,,a,,...,a,)} be a finite set with n elements, n = 2. There 
are n!/2 even permutations and n!/2 odd permutations. 


Proof: Let A,,, be the set of all even permutations of A, and let B, be the 
set of all odd permutations. We shall define a function f: A, — B,, which we 
show is one to one and onto, and this will show that A, and B, have the 
same number of elements. 
Since n = 2, we can choose a particular transposition gy of A. Say that 
do = (4,-1,4,). We now define the function f: A, > B, by 
fp) =doep, PEA. 


Observe that if p € A,, then p is an even permutation, so gy ° p is an odd 
permutation and thus f (p) € B,. Suppose now that p, and p, are in A, and 


F (pi) = f(p2). 
Then 
% ° Pi = 40° Po: (2) 
We now compose each side of equation (2) with gp: 
90° (4o° Pi) = Ao? (40° Po): 
so, by the associative property, 


(Go ° Yo) ° Pi: = (40° Fo) ° P2 
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OF, SINCE Jo ° do = La, 
14° Pi = 14° Po 
P\ = Po: 


Thus fis one to one. 
Now let q € B,,. Then q,° g € A,, and 


fqo° 2) = 40° (40° 9) 

= (40°45) ° 49 

=14eq 

=4q, 
which means that f is an cnto function. Since f: A, > B, is one to one and 
onto, we conclude that A, and B, have the same number of elements. Note 
that A, N B, = © since no permutation can be both even and odd. Also, by 
Theorem 1,!A, U B,| = n!.Thus, by Theorem 2 of Section 1.2, 


ni =|A,U B,| =!A,) + |B,| -]A, 9B, = 2/4, 
We then have 


ni 
[4,| = |B,| =. ° 
EXERCISE SET 5.3 

1. Which of the following functions f: R > R are 3. Compute 

permutations of R? (a) py? (b) p3° py 

(a) fis defined by f(a) = a — 1. (c) (P2°Pi)°P2 (A) Pre (P32 Pz") 

(b) fis defined by f(a) = a’. 

(c) fis defined by f(a) = a’. rae 

(d) fis defined by f(a) = e°. a ompute: ude oes 

(a) p3’ (b) pre pz" 


(c) (p3° Py) ° Py (d) p30 (Pp, op,)t 


2. Which of the following functions f: Z — Z are 
permutations of Z? 


(a) fis defined by f(a) =a + 1. 


In Exercises 5 and 6, let A = {1,2,3,4,5, 6,7, 8}. 


(b) fis defined by f(a) = (a— 1)’, Compute the products. 
(c) fis defined by f(a) = a? + 1. 
(d) fis defined by f(a) = a? — 3. 


In Exercises 3 and 4, let A = {1,2,3, 4,5, 6} and 


wd wh & 


3 


Nw Bw Re 


5. (a) (3,5,7,8) o (1,3, 2) 
(b) (2, 6) o (3,5, 7,8) ° (2, 5, 3,4) 


4 5 6 
a y 6. (a) (1,4) © (2,4, 5,6) © (1,4, 6.7) 

(b) (5,8) © (1, 2, 3, 4) ¢ (3, 5, 6, 7) 
4 5 ‘ 
5 4 6 

7. Let A = {a,b,c, d, e, f, g}. Compute the products. 

45 6 (a) (a. f,8) ° (b,c, d,e) 
5 4 1 (b) (f.g) ° (b,c, f) ° (a, b,c) 


In Exercises 8 and 9, let A = {1,2,3,4,5, 6,7, 8}. 
Write each permutation as the product of dis- 
joint cycles. 


8. 


9, 


10. 


11. 


@ (i 2345678 
43S BS LB Pg 
£2 GOR G0 88 

oes are 

@m{i 2345678 
6ST Body SO A 
1 O34 5.6 7 8 

Cosy aea 


Let A = {a,b,c, d, e, f, g}. Write each permuta- 
tion as the product of disjoint cycles. 


ab cede fg 
Ops 


abede fg 
Oe oo) 


Let A = (1,2, 3, 4,5, 6, 7, 8}. Write each permu- 
tation as a product of transpositions. 

(a) (2,1, 4,5, 8, 6) 

(b) (3, 1, 6) o (4, 8, 2, 5) 


In Exercises 12 and 13, let A = {1,2,3,4,5, 6,7, 8}. 
Determine whether the permutation is even or 


odd. 
12345678 
2. (@ ( (ae ae ae ae ae 
De Be BG ak 
Ghee ae | 
13. (a) (6,4,2,1,5) 


(b) (4,8) (3, 5,2, 1) ° (2, 4,7, 1) 


14. Prove that 


(a) The product of two even permutations is 
even. 

(b) The product of two odd permutations is 
even. 


15. 


16. 


17, 


18. 


19. 


20. 
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(c) The product of an even and an odd permu- 
tation is odd. 


Let A = (1,2, 3,4, 5}. Let f = (5, 2,3) and 

g = (3,4, 1) be permutations of A. Compute 
each of the following and write the result as the 
product of disjoint cycles. 


(a) fog  (b) frteg™! 


Show that if p is a permutation of a finite set A, 
then p” = pe p isa permutation of A. 


Let A = {1, 2,3, 4,5, 6} and 


Lf 23 a or 
Plo 43°15 6 


be a permutation of A. 

(a) Write p as a product of disjoint cycles. 

(b) Compute p7!. 

(c) Compute p’. 

(d) Find the period of p, that is, the smallest 
positive integer k such that p* = 1,. 


Let A = {1,2,3, 4,5, 6} and 


(12345 6 
OPN ag. Age Es Be iG 


be a permutation of A. 

(a) Write p as a product of disjoint cycles. 

(b) Compute p7’. 

(c) Compute p?. 

(d) Find the period of p, that is, the smallest 
positive integer & such that p* = 1,. 


(a) Use mathematical induction to show that if 
p isa permutation of a finite set A, then 
p" = popo::+opisa permutation of A 
forneEZ*. 

(b) If A is a finite set and p is a permutation of 
A, show that p” = 1, for some m € Z*. 


Let p be a permutation of a set A. Define the 
following relation R on A: a R b if and only if 
p"(a) = b for some n © Z.[p’ is defined as the 
identity permutation and p~” is defined as 
(p~')".] Show that R is an equivalence relation 
and describe the equivalence classes. 
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5.4. Growth of Functions 


In the earlier discussion of computer representations of relations (Section 4.6), 
we saw that one of the factors determining the choice of storage method is the 
efficiency of handling the data. [In the example of testing to see if a relation is 
transitive, the average number cf steps needed was computed for an algorithm 
with the relation stored as a matrix and for an algorithm with the relation stored 
using a linked list. The results were that it would take roughly kn? + (1 — k)n? 
steps using matrix storage and k°n* steps using a linked list, where the relation 
contains kn? ordered pairs. Although many details were ignored, these rough 
comparisons give enough inforrnation to make some decisions about appropriate 
data storage. In this section we apply some concepts from previous sections and 
lay the groundwork for more sophisticated analysis of algorithms. 

The idea of one function growing more rapidly than another arises naturally 
when working with functions. In this section we formalize this notion. 


Example 1. Let R be a relation on a set A with |A| =n and |R| = $n7. If R is 
stored as a matrix, then t(n) = zn? + $n? is a function that describes (roughly) 
the average number of steps needed to determine if R is transitive using the algo- 
rithm TRANS (Section 4.6). Storing R with a linked list and using NE WIBANS 
the average number of steps needed is (roughly) given by s(n) = int Table 5.1 
shows that s grows faster than ¢. 


TABLE 5.1 
n t(n) s(n) 
10 550 1250 
50 63,750 781,250 


100 505,000 12,500,000 e 


Let f and g be functions whose domains are subsets of Z*, the positive inte- 
gers. We say that fis O(g), read “)'is big-Oh of g,” if there exist constants c and k 
such that | f(n)| = c-|g(n)| for alln = k. If fis O(g), then f grows no faster than 
g does. 


Example 2. The function f() = 413 + $n? is O(g) for g(n) = n°. To sce this, 
consider 


1 
tay Ls Lyi a, ifn =1. 


2 2 2 2 
Thus, 
1 
amas ms den, ifn =1. 


Choosing 1 for c and 1 for k, we have shown that | f(n)|<c-|g(n)| for alln = é 
and f is O(g). 
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The reader can see from Example 2 that other choices of c, k, and even 
g are possible. If |f(1)| < c|g(n)| for all n = k, then we have - |g(n), 
for all n = k for any C= c,and f(n)| <c+|g(n)| for alln = K for any K = k. 
For the function ¢ in Example 2, t is O(h) for h(n) = dn®, if d = 1, since 
je) | =1-|g(n)|= [rool Observe also that ¢ is O(r(n)) for r(x) = n‘, because 
zn? +5n? <n? <n" for all n = 1. When analyzing algorithms, we want to know 
the “slowest growing” simple function g for which fis O(g). 

It is common to replace g in O(g) with the formula that defines g. Thus we 
write that ¢ is O(n°). This is called big-O notation. 

We say f and g have the same order if fis O(g) and g is O(f). 


Example 3. Let f(n) = 3n‘ — 5n” and g(n) = n‘ be defined for positive integers 
n. Then f and g have the same order. First, 


3n* ~ Sn? <3n* + 5x? 
<3n'+5n', ifn 21 
= $n‘. 
Letc = 8 and k = 1, then |f(n)| < ¢ - |g(n)| for all n = k. Thus f is O(g). 
Conversely, n‘ = 3n* — 2n‘ = 3n* — 5n’ if n = 2. This is because if n = 2, then 
nv > ,2n? > 5, and 2n* > Sn. Using 1 for c and 2 for k, we conclude that g is 


O(f). ° 


If f is O(g) but g is not O(f), we say that f is lower order than g or that f 
grows more slowly than g. 


Example 4. The function f(n) = n° is lower order than g(n) = n’. Clearly, if 
n = 1, then n° = n’. Suppose that there exist c and k such that n’ < cn’ for all 
n = k. Choose N so that N > k and N’ > c. Then N’ = cN*® < N?- N°*, but this 
is a contradiction. Hence f is O(g), but g is not O(f), and fis lower order than g. 
This agrees with our experience that n° grows more slowly than n’. ° 


We define a relation 0, big-theta, on functions whose domains are subsets 
of Z* as f O gif and only if f and g have the same order. 


Theorem 1. The relation © defined above is an equivalence relation. 


Proof: Clearly, © is reflexive since every function has the same order as 
itself. Because the definition of same order treats f and g in the same way, 
this definition is symmetric and the relation © is symmetric. 

To sce that © is transitive, suppose f and g have the same order. Then 
there exist c, and k, with |f(n)| = ¢, -|g(n)| for all n = k,, and there exist 
c, and k, with |g(m)| <= c, - |f(1)| for all a = k,. Suppose that g and # have 
the same order; then there exist c, k, with |g(n)| = c,-|h(n)| for all = k,, 
and there exist c,, k, with |A(n)| = ¢,° |g(n)| for alln = ky. 

Then |f(n)| = c, « |g(n)| = ¢(c, « [h(n)|) ifn = k, ald n = k,. Thus 
|f(n)| = c,¢3° |k()| for all n = maximum of k, and k;. 

Similarly, |4(n)| < c)c, + |f(n)| for all n = maximum of &, and k,. Thus f 
and h have the same order and 0 is transitive. 5 
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Functions 


The equivalence classes cf © consist of functions that have the same order. 
We use any simple function in the equivalence class to represent the order of all 
functions in that class. One © class is said to be lower than another © class if a 
representative function from the first is of lower order than one from the second 
class. This means functions in the first class grow more slowly than those in the 
second. It is the © class of a function that gives the information we need for algo- 
rithm analysis. 


Example 5. All functions that have the same order as g(n) = n° are said to have 
order @(n>). The most common orders in computer science applications are O(1), 
O(n), O(n”), O(n7), O(lg(n)), Bn Ig(n)), and O(2"). Here O(1) represents the 
class of constant functions and /z is the base 2 log function. Some of these func- 
tions are shown in Figure 5.6. a 


Figure 5.6 


Example 6. Every logarithmic: function f() = log,() has the same order as 


g(n) = Ig(n). There is a logarithmic change-of-base identity log,(x) = ee 


Sec. 5.3. Permutation Functions 193 


in which log,(b) is a constant. Thus |log,(n)| < oo |ig(n)| and, conversely, 
[le(7)| = Ig(b) - |log,(n)|. Hence g is O(f) and f is O(g). o 


It is sometimes necessary to combine functions that give the number of steps 
required for pieces of an algorithm as is done in the analysis of TRANS (Section 
4.6), where functions are added, and in the analysis of NEWTRANS, where func- 
tions are multiplied. There are some general rules regarding the ordering of the O 
equivalence classes that can be used to determine the class of many functions and 
the class of the sum or product of previously classified functions. 


Rules for Determining the 6 Class of a Function 


1. @(1) functions are constant and have zero growth, the slowest growth pos- 
sible. 

2. O(/g(n)) is lower than O(n*) if k > 0. This means that any logarithmic func- 
tion grows more slowly than any power function with positive exponent. 

3. O(n’) is lower than O(n?) if and only if a < b. 

4, O(a") is lower than O(b") if and only if a < b. 

5. Q(n*) is lower than O(a") for any power n* and any a > 1. This means that 
any exponential function with base greater than 1 grows more rapidly than 
any power function. 

6. If ris not zero, then O(rf) = O(f) for any function f. 

7. Ifh is a nonzero function and O(/) is lower than (or the same as) O(g), then 
Q(fh) is lower than (or the same as) O(gA). 

8. If O(f) is lower than O(g), then O(f + g) = O(g). 


Example 7. Determine the © class of each of the following. 
(a) fn) = 4n* — 6n’ + 25n? 
(b) a(n) = Ig(n) — 3n 
(c) h(n) = 1.1" +n 
Solution: (a) By Rules 3, 6, and 8, the degree of the polynomial deter- 
mines the O class of a polynomial function. O(f) = O(n’). 
(b) Using Rules 2, 6, and 8, we have that @(g) = O(n). 
(c) By Rules 5 and 8, 0(h) = O(1.1"). o 


Example 8. Using the rules for ordering © classes, arrange the following in 
order from lowest to highest. 

O(n Ig(n)) ©(1000n? — n) O(n°?) (1,000,000) 6(1.3") O(n + 10’) 
Solution: ©(1,000,000) is the class of constant functions, so it is the first on 
the list. By Rules 5 and 8, O(n + 10’) is lower than 6(1000n? — n), but 
higher than 6(n°”). To determine the position of O(n lg(n)) on the list, we 
apply Rules 2 and 7. These give that O(n /g(n)) is lower than O(n”) and high- 
er than O(7). Rule 5 says that O(1.3”) is the highest class on this list. In 
order, the classes are 


(1,000,000) (n°?) O(7+ 10’) O(n Ig(n)) O(1000n? ~- n) 0(1.3"). 
o 
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The 0 class of a function that describes the number of steps performed by 
an algorithm is frequently referred to as the running time of the algorithm. For 
example, the algorithm TRANS has an average running time of n°. In general, 
algorithms with exponential running times are impractical for all but very small 


values of n. 


EXERCISE SET 5.4 


In Exercises \ and 2, let f be a function that 
describes the number of steps required to carry 


out a certain algorithm. The number of items to be 


processed is represented by n. For each function, 
describe what happens to the number of steps if 
the number of items is doubled. 


1. (a) f(n) = 1001 (b) f(n) =3n 
(c) f(n) = Sn? (d) f(n) = 2.573 
(e) f(a) =14ig(n) — (f) fa) = 2" 


N 


» (a) f) = nigtn) (b) fl) = 100 n* 

3. Show that g(n) = n! is O77’). 

4. Show that h(n) =14+2+3+---+nis O(n”). 
5. Show that f(n) = 87 + Ig(n) is O(n). 


6. Show that g(#) = n7(7n — 2) is O(n’). 


7. Show that f(7) = n ig() is O(g) for g(n) = n’, but 


that g is not O(f). 


8. Show that f(x) = 2' is O(g) for g(n) = 2", but 


that g is not O( f). 


9. Show that f and g have the same order for 
f(n) = Sn? + 4n + 3 and p(n) = n? + 100n. 


10. Show that f and g have the same order for 
f(n) = Ig(n*) and g(n) = log;(6n). 


11. Determine which of the following are in the same 


6 class. A function may be in a class by itself. 


fia) = 5n ign), f)(n) = 6n? - 3n + 7, 
f(r) = 1.5", fan) = len’), fe(n) = 13,463, 


12. 


fon) = —15n, f,(n) = Igig(n)), fl) = 9n°’, 
far) = nt, fio) = 1 + la(n), 


ful = Va + 12h, fio{n) = Ig(n!) 


Order the © classes in Exercise 11 from lowest to 
highest. 


In Exercises 13 through 18, analyze the operation 
performed by the given piece of pseudocode and 
write a function that describes the number of steps 
required. Give the © class of the function. 


13. 


14. 


15. 


16. 


17. 


1 Ael 

2. Bel 

3. UNTIL (B > 100) 
a. Be2A-2 
b AGA+3 

1. Xe1 

2. Ye 100 

3. WHILE (X < Y) 
a XeX+2 
b. Yesy 

1. Tel 

2, X<0 

3. WHILE (= N) 
a. Xe X+1 
bo Tel+i1 

1. SUM<0O 


2. FOR] = 0 THRU 2(N - 1) BY 2 
a. SUM<—SUM+I1 


Let A be an array of length N and X an item that 
may be stored in A. In this exercise, the function 
should describe the average number of steps 
needed to determine if X is stored in A. 


gat SEEK(A, X) 
FOUND < FALSE 
Hi Kel 
3. WHILE (NOT FOUND) AND (K < N) 
a. IF (A{K] = X) THEN 
1. FOUND <« TRUE 


b. ELSE 
1KeK+1 
4. RETURN 


18. SUBROUTINE MATMUL(A, B, N, M, P,Q; C) 


1. IF (M = P) THEN 
a. FOR/=1THRUN 


KEY IDEAS FOR REVIEW 


-e+¢ 


od 


Function: see page 167. 

Identity function, 1,:1,(a) = a 

One-to-one function f from A to B: a # a’ 
implies f (a) # f(a’) 

Onto function f from A to B: Ran(f) = 
Bijection: one-to-one and onto function 
One-to-one correspondence: onto, one-to-one, 
everywhere defined function 

If f is a function from A to B, 1, ° f = f; 
fol,=f 

If f is an invertible function from A to B, 
eS ea! ae eg 

ly A ee ies a 

Boolean function f: Ran(f) C {true, false}. 
Hashing function: see page 179. 

Permutation function: a bijection from a set A 
to itself 

Theorem: If A is a set that has 7 elements, then 
there are n! permutations of A. 

Cycle of length r: (b,, b,,..., b,); see page 183 
Theorem: A permutation of a finite set that is 
not the identity or a cycle can be written as a 
product of disjoint cycles. 

Transposition: a cycle of length 2 

Corollary: Every permutation of a finite set 
with at least two elements can be written as a 
product of transpositions. 


+ 
¢ 


+ 


+ 


+ 


+ 
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Key Ideas for Review 


1. FORJ=1THRUQ 
a. CL J|—0 
b. FOR K =1THRUM 
1 CIA + 
(All, K] x BLK, J]) 
2. ELSE 


a. CALL PRINT (INCOMPATIBLE’) 
3. RETURN 
END OF SUBROUTINE MATMUL 


19, Prove Rule 3. 


20. Prove Rule 7. 


Even (odd) permutation: one that can be writ- 
ten as a product of an even (odd) number of 
transpositions 


Theorem: If a permutation of a finite set can be 
written as a product of an even number of 
transpositions, then it can never be written as a 
product of an odd number of transpositions, 
and conversely. 

The product of: 

(a) Two even permutations is even. 

(b) Two odd permutations is even. 

(c) Aneven and an odd permutation is odd. 
Theorem: If A is a set that has n elements, then 
there are m!/2 even permutations and n!/2 odd 
permutations of A. 

O(g) (big Oh of g): see page 191. 

f and g of the same order: f is O(g) and g is 
O(f). 

Theorem: The relation 0, fOg if and only if 
fand g have the same order, is an equivalence 
relation. 

Lower 6 class: see page 192 

Rules for determining 9 class of a function: see 
page 192 

Running time of an algorithm: 0 class of a func- 
tion that describes the number of steps per- 
formed by the algorithm 
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CODING EXERCISES 


For each of the following, write the requested pro- 
gram or subroutine in pseudocode (as described in 
Appendix A) or in a programming language that 
you know. Test your code either with a paper-and- 
pencil trace or with a computer run. 


1. Let U = {u,, u,...,u,} be the universal set 
for possible input sets. Write a function 
CHAREFCN that, given a set as input, returns 
the characteristic function of the set as a 
sequence. 


2. Write a function TRANSPOSE that, given an 
n X n matrix, returns its transpose. 


4. 


wn 
5 


Write a program that writes a given permuta- 
tion as a product of disjoint cycles. 


Write a program that writes a given permuta- 
tion as a product of transpositions. 


Use the program in Exercise 4 as a subrou- 
tine in a program that determines whether a 
given permutation is even or odd. 


CHAPTE 


Prerequisites: Chapters 3 and 5 


6.1. Graphs 


Graph theory begins with very simple geometric ideas and has many powerful 
applications. Some uses of graphs are discussed in Chapters 4, 7, and 8. In those 
chapters a graph is associated with the digraph of a symmetric relation. By com- 
bining those ideas with that of function, we can define a more general type of 
graph that allows more than one edge between the same vertices. Sometimes this 
type of graph is called a multigraph. 

A graph G consists of a finite set V of objects called vertices, a finite set E 
of objects called edges, and a function y that assigns to each edge a subset {v, w}, 
where v and w are vertices (and may be the same). We will write G = (V, E, y) 
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Topics in Graph Theory 


when we need to emphasize the components of G. If e is an edge, and 
y(e) = {v, w}, we say that e is an edge between v and w and that e is determined 
by v and w. The vertices v and w are called the end points of e. If there is only one 
edge between v and w, we often identify e with the set {v, w}. This should cause no 
confusion. The restriction that there are only a finite number of vertices may be 
dropped, but for the discussion. here all graphs have a finite number of vertices. 


Example 1. Let V = {1,2,3,4} and E = {e;, €5, €3, ey, es}. Let y be defined by 


ye) = ves) = {1,2}, r€@) = {4.3}, ves) = {1,3}, (ea) = {2,4}. 
Then G = (V,E£, y) is a graph. e 


Graphs are usually represented by pictures using a point for each vertex 
and a line for each edge. G is represented as shown in Figure 6.1. We usually omit 
the names of the edges, since they have no intrinsic meaning. Also, we may want 
to put other more useful labels on the edges. We sometimes omit the labels on 
vertices as well if the graphica! information is adequate for the discussion. 


Figure 6.1 4 3 


Graphs are often used to record information about relationships or con- 
nections. An edge between v; and v, indicates a connection between the objects v, 
and v,. In a pictorial represeritation of a graph, the connections are the most 
important information, and generally a number of different pictures may repre- 
sent the same graph. 


Example 2. Figures 6.2 and 6.2 also represent the graph G given in Example 1. 


¢ 
1 2 
1 4 
3 4 
Figure 6.2 Figure 6.3 


The degree of a vertex is the number of edges having that vertex as an end 
point. A graph may contain ar. edge from a vertex to itself; such an edge is 
referred to as a loop. A loop contributes 2 to the degree of a vertex. 


Example 3 


(a) In the graph in Figure 6.4, the vertex A has degree 2, vertex B has degree 4, 
and vertex D has degree 3. 
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(b) In Figure 6.5, vertex a has degree 4, vertex e has degree 0, and vertex b has 
degree 2. 


(c) Each vertex of the graph in Figure 6.6 has degree 2. « 

A B 

2 5 
E Cc 

3 
4 
D 

1 6 

Figure 6.4 Figure 6.5 Figure 6.6 


A vertex with degree 0 will be called an isolated vertex. A pair of vertices 
that determine an edge are adjacent vertices. 


Example 4. In Figure 6.5, vertex e is an isolated vertex. In Figure 6.5, a and b 
are adjacent vertices; vertices a and d are not adjacent. od 


A path in a graph is a sequence 7: v,,v>,..., Vv, of vertices, each adjacent to 
the next, and a choice of an edge between each v, and v,,, so that no edge is cho- 
sen more than once. Pictorially, this means that it is possible to begin at v, and 
travel along edges to v, and never use the same edge twice. 

A circuit is a path that begins and ends with the same vertex. In Chapter 4 
we call such paths cycles; the word circuit is more common in general graph the- 


ory. A path ¥,, ¥),..., V, is called simple if no vertex appears more than once. 
Similarly, a circuit v1, v2,..., Vj_1, ¥; 18 simple if the vertices v,,v,,..., y_, are all 
distinct. 

Example 5 


(a) One path in the graph represented by Figure 6.2 is 7,: 1, 3, 4, 2. 

(b) Paths in the graph of Figure 6.4 include z,: D, E, B, C, 7: A, B, E, D, D, and 
a4: A, B, A. Note that in 7, we do not specify which edge between A and B 
is used first. 

(c) Examples of paths in the graph of Figure 6.5 are 7: a,b,c, a and 7: d, c, a, 
a. The path 7, is a circuit. 

(d) In Figure 6.6 the sequence 1, 2, 3, 2 is not a path, since the single edge be- 
tween 2 and 3 would be traveled twice. 

(e) The path 2: c, a, b, c,d in Figure 6.5 is not simple. ¢ 


A graph is called connected if there is a path from any vertex to any other 
vertex in the graph. Otherwise, the graph is disconnected. If the graph is discon- 
nected, the various connected pieces are called the components of the graph. 
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Example 6. The graphs in Figures 6.1 and 6.4 are connected. Those in Figures 
6.5 and 6.6 are disconnected. The graph of Figure 6.6 has two components. @ 


Some important special farnilies of graphs will be useful as examples in our 
discussions. We present them here. 

1. For each integer = 1, we let D, denote the graph with nv vertices and no 
edges. Figure 6.7 shows D, and D,. We call D, the discrete graph on x vertices. 


. on eo e@08 0@ @ 
Dy Ds 
Figure 6.7 
2. For each integer n = 1, let K, denote the graph with vertices {v,,v,,...,v,} 


and with an edge {v,, ,} for every i and j. In other words, every vertex in K,, is con- 
nected to every other vertex. In Figure 6.8 we show K;, K,, and K,. The graph K,, 
is called the complete graph or. n vertices. More generally, if each vertex of a 
graph has the same degree as every other vertex, the graph is called regular. The 
graphs D,, are also regular. 


K; K4 Ks 
Figure 6.8 
3. For each integer n = |, we let L, denote the graph with 7 vertices 


{v,,v,,...,¥,} and with edges {1.. v.,,} for 1 <i <n. We show L, and L, in Figure 
6.9. We call L,, the linear graph on 7 vertices. 


oe ooo 
Ly L4 
Figure 6.9 


Example 7. All the K, and L, are connected, while the D,, are disconnected. In 
fact, the graph D,, has exactly n components. 6 


Subgraphs and Quotient Graphs 


Suppose that G = (V, E, y) is a graph. Choose a subset F, of the edges in E and 
a subset V, of the vertices in V, so that V, contains (at least) all the end points of 
edges in E,. Then H = (V,, E,, y,) is also a graph where y, is y restricted to edges 
in £,. Such a graph H is called a subgraph of G. Subgraphs play an important role 
in analyzing graph properties. 
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Example 8. The graphs shown in Figures 6.11, 6.12, and 6.13 are each a sub- 
graph of the graph shown in Figure 6.10. e 


A B 


D Cc 
Figure 6.10 
B 
E F E F 
Lt y 

D Cc D Cc 
Figure 6.11 Figure 6.12 

A B 

E F 
D Cc 


Figure 6.13 
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One of the most important subgraphs is the one that arises by deleting one 
edge and no vertices. If G = (V, E, y) is a graph and e € E, then we denote by G, 
the subgraph obtained by omitting the edge e from E and keeping all vertices. If G 
is the graph of Figure 6.10, and ¢ = {A, B}, then G, is the graph shown in Figure 6.13. 

Our second important construction is defined for graphs without multiple 
edges. Suppose that G = (V, ©, y) is such a graph and that R is an equivalence 
relation on the set V. Then we construct the quotient graph G* in the following 
way. The vertices of G* are the equivalence classes of V produced by R (see 
Section 4.5). If [v] and (w] are the equivalence classes of vertices v and w of G, 
then there is an edge in G* from [v] to [w] if some vertex in [v] is connected to 
some vertex in (w] in the graph G. Informally, this just says that we get G* by 
merging all the vertices in each equivalence class into a single vertex and com- 
bining any edges that are superimposed by such a process. 


Example 9. Let G be the graph of Figure 6.14 (which has no multiple edges), 
and let R be the equivalence relation on V defined by the partition {{A, £, J}, 
{B, F,J),{C, G, K}, (D, H, L}}. Then G* is shown in Figure 6.15. 

If S is also an equivalence relation on V defined by the partition {{J, J, K, L}, 
{A, E}, {F, B, C}, [D}, {G}, {AN}, then the quotient graph G‘ is shown in Figure 6.16. 


¢ 
A B 
E FB 
pg [A] [B] 
L K 
D ‘ Cc wi [cl 
Figure 6.14 Figure 6.15 


© Re 
( 
ac \ cee 


[D] D Cc 
Figure 6.16 Figure 6.17 


Sec.6.1 Graphs 203 


Again, one of the most important cases arises from using just one edge. If e 
is an edge between vertex v and vertex w in a graph G = {V, E, y}, then we con- 
sider the equivalence relation whose partition consists of {v, w} and {v,}, for each 
v, # v, ¥ # w. That is, we merge v and w and leave everything else alone. The 
resulting quotient graph is denoted G°. If G is the graph of Figure 6.14, and 
e = {f, J}, then G* is the graph shown in Figure 6.17. 


EXERCISE SET 6.1 


In Exercises 1 through 4, give V, the set of vertices, 
and E, the set of edges, for the graph G = (V,E, y) 


given in Figures 6.18 through 6.21. 


1 6A B D 


Figure 6.18 


2. A B 


D E 
Figure 6.19 


Figure 6.21 


7. 


13. 


14. 


. Draw a picture of the graph G = (V, £, y), where 


V = (A, B,C, D, E}, E = (e1, &5, es, C4 Cs, Cots 
and y(e,) = y(es) = (A, C}, y(e.) = {A, D}, 
yes) = {E, C}, v(e,) = (B, C}, and y(e,) = (E, D}. 


. Draw a picture of the graph G = (V,E, y), 


where V = [A, B,C, D, E, F, G, H}, E = 

{e,, €g,...,@9}, and y(e,) = {A, C}, y(e.) = 

(A, B}, y(e3) = [D, C}, y(ex) = (B. D}, yles) = 
{E, A}, vee) = [E, D}, lez) = (F, Eh, yes) = 
{E, G}, and y(e,) = {F, G}. 


Give the degree of each vertex in Figure 6.18. 


. Give the degree of each vertex in Figure 6.20. 


List all paths that begin at A in Figure 6.19. 


. List three circuits that begin at 5 in Figure 6.21. 


Draw the complete graph on seven vertices. 


Consider K,, the complete graph on n vertices. 
What is the degree of each vertex? 


Which of the graphs in Exercises 1 through 4 
are regular? 


Give an example of a regular, connected graph 
on six vertices that is not complete. 


For Exercises 15 and 16, use the graph in Figure 
6.22, 


Cc 
Figure 6.22 
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15. If R is the equivalence relation defined by the 17. Let R = {(1, 1), (2, 2), (3, 3), (4, 4), (5, 5), (6, 6), 
partition {{a, f), {e, b, a}. {c}}, find the quotient (7,7), (8, 8), (9, 9), (10, 10), (11, 11), (12, 12), 
graph, G*. (13, 13), (14, 14), (15, 15), (16, 16), (1, 10), 

(10, 1), (3, 12), (12, 3), (5, 14), (14, 5), (2, 11), 

16. If R is the equivalence relation defined by the (11,2), (4, 13), (13, 4), (6, 15), (15, 6), (7, 16), 
partition {{a, 6}, (e}, {4}, Uf, c}}, find the quotient (16, 7), (8, 9), (9, 8)}. Draw the quotient graph G*. 
graph, G®, 

18. Let R = {(1, 1), (2,2), (3, 3). (4,4), (5, 5), (6, 6), 

For Exercises 17 and 18, use the graph in Figure (7,7), (8, 8), (9, 9), (10, 10), (11, 11), (12, 12), 

6.23. (13, 13), (14, 14), (15, 15), (16, 16), (1, 2), (2, 1), 


(3, 4), (4, 3), (5, 6), (6, 5), (7, 8), (8, 7), (9, 16), 
(16, 9), (10, 11), (11, 10), (12, 13), (13, 12), 
(14, 15), (15, 14)}. Draw the quotient graph G’. 


19. Complete the following statement. Every linear 
graph on n vertices must have edges. 
Explain your answer. 


20. What is the total number of edges in K,,, the 
complete graph on n vertices? Justify your 


Figure 6.23 answer. 


6.2. Euler Path and Circuits 


In this section and the next, we consider broad categories of problems for which 
graph theory is used. In the first type of problem, the task is to travel a path using 
each edge of the graph exactly a.1ce. It may or may not be necessary to begin and 
end at the same vertex. A simple example of this is the common puzzle problem 
that asks the solver to trace a geometric figure without lifting pencil from paper. 

A path in a graph G is called an Euler path if it includes every edge exactly 
once. An Euler circuit is an Euler path that is a circuit. 


Example 1. Figure 6.24 shows the street map of a small neighborhood. A recy- 
cling ordinance has been passed, and those responsible for picking up the recy- 
clables must start and end each trip by having the truck in the recycling terminal. 
They would like to plan the truck route so that the entire neighborhood can be 
covered and each street need be traveled only once. A graph can be constructed 
having one vertex for each intersection and an edge for each street between any 
two intersections. The problem then is to find an Euler circuit for this graph. @ 


Example 2 

(a) An Euler path in Figure 6.25 is a: E, D, B, A, C, D. 

(b) One Euler circuit in the graph of Figure 6.26 is 7: 5,3,2,1,3,4,5. . 4 
A little experimentation will show that no Euler circuit is possible for the 


graph in Figure 6.25. We also see that an Euler path is not possible for the graph 
in Figure 6.6. (Why?) 
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Figure 6.24 
E 
2 4 
B Cc > a 
; 
A 1 5 
Figure 6.25 Figure 6.26 


Example 3. Consider the floor plan of a three-room structure that is shown in 


Figure 6.27. 


Room A Room B 


D (Outside) 


Figure 6.27 
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Each room is connected to every room that it shares a wall with and to the out- 
side along each wall. The problem is this. Is it possible to begin in a room or out- 
side and take a walk that goes through each door exactly once? This diagram can 
also be formulated as a graph where each room and the outside constitute a ver- 
tex and an edge corresponds to each door. A possible graph for this structure is 
shown in Figure 6.28. The translation of the problem is whether or not there 


exists an Euler path for this graph. We will also solve this problem later. ca 
A #~ B 
\ 
\ 
Cc 
Figure 6.28 


Two questions arise naturally at this point. It is possible to determine 
whether an Euler path or Euler circuit exists without actually finding it? If there 
must be an Euler path or circuit, is there an efficient way to find one? 

Consider again the graphs in Example 2. In Figure 6.25 the edge {D, E} must 
be either the first or the last traveled, because there is no other way to travel to or 
from vertex E. This means that if G has a vertex of degree 1, there cannot be an 
Euler circuit, and if there is an Euler path, it must begin or end at this vertex. A 
similar argument applies to any vertex v of odd degree, say 2n + 1. We may travel 
in on one of these edges and out on another one n times, leaving one edge from 
v untraveled. This last edge may be used for leaving v or arriving at v, but not 
both, so a circuit cannot be corngleted. We have just shown the first of the fol- 
lowing results. 


Theorem 1 
(a) If a graph G has a vertex of odd degree, there can be no Euler circuit in 


(b) If Gis a connected graph and every vertex has even degree, then there is 
an Euler circuit in G. 


Proof: (b) Suppose that taere are connected graphs where every vertex 
has even degree, but there is no Euler circuit. Choose such a G with the 
smallest number of edges. G' must have more than one vertex since, if there 
were only one vertex of even degree, there is clearly an Euler circuit. Let v 
be a vertex of G. We first note that there must be a circuit that begins and 
ends at v. Since the degree of v is at least two and G is connected, there 
must be distinct edges between v and vertices a and b (which may be the 
same vertex), Since G is conaected, there must be a path a, v,,v),...,b. Then 
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V, 4, V1, ¥2,...,6, Vis a circuit that begins and ends at v. Suppose that 7: 
v,u,..., vis the longest possible circuit beginning and ending at v. Since G 
does not have an Euler circuit, not all the edges of G are used in 7. Let G’ 
be the graph formed by deleting the edges of 7 from G. Since vis a circuit, 
deleting its edges reduces the degree of each vertex by 0 or 2; so G’ is also 
a graph whose vertices all have even degree. The graph of G may not be 
connected, but some piece of it is. We choose the largest connected piece of 
G’. This piece must have an Euler circuit 7’ because it certainly has fewer 
edges than G, and G was chosen to have the smallest number of edges with- 
out an Euler circuit. 

Either 7’ contains all the vertices of G or there is some vertex v not in 
a’. But v must be adjacent to some v’ in 7’ since G is connected and the 
edge {v, v’} is one of the deleted edges: that is, {v, v’} is an edge of 7. In either 
case, some vertex v’ in 77’ is also in 7, and we can construct a longer circuit 
in G by joining 7 and 7’ at v’. But this is a contradiction, because 7 was the 
longest possible circuit in G. Thus no such G can exist. ¢ 


We have proved that if G has vertices of odd degree, it is not possible to 
construct an Euler circuit for G, but an Euler path may be possible. Our earlier 
discussion noted that a vertex of odd degree must be either the beginning or the 
end of any possible Euler path. We have the following theorem. 


Theorem 2 
(a) Ifa graph G has more than two vertices of odd degree, then there can be 
no Euler path in G. 
(b) If G is connected and has exactly two vertices of odd degree, there is an 
Euler path in G. Any Euler path in G must begin at one vertex of odd 
degree and end at the other. 


Proof: (a) Let v,, v,, v3 be vertices of odd degree. Any possible Euler path 
must leave (or arrive at) each of v,, v2, v; with no way to return (or leave) 
since each of these vertices has odd degree. One vertex of these three ver- 
tices may be the beginning of the Euler path and another the end, but this 
leaves the third vertex at one end of an untraveled edge. Thus there is no 
Euler path. 

(b) Let u and v be the two vertices of odd degree. Adding the edge {u, v} 
to G produces a connected graph G’ all of whose vertices have even degree. 
By Theorem 1(b), there is an Euler circuit 7’ in G’. Omitting {u,v} from 77’ 
produces an Euler path that begins at u (or v) and ends at v (or uw). Sd 


Example 4. Which of the graphs in Figures 6.29, 6.30, and 6.31 have an Euler 
circuit, an Euler path but not an Euler circuit, or neither? 


Solution: (a) In Figure 6.29, each of the four vertices has degree 3; thus, by 
Theorems 1 and 2, there is neither an Euler circuit nor an Euler path. 

(b) The graph in Figure 6.30 has exactly two vertices of odd degree. 
There is no Euler circuit, but there must be an Euler path. 

(c) In Figure 6.31, every vertex has even degree; thus the graph must 
have an Euler circuit. ° 


208 = Chapter6 = Topics in Graph Theory 


x A 


Figure 6.29 Figure 6.30 


Figure 6.31 


Example 5. Let us return to Example 3. We see that the four vertices have 
degrees 4, 4, 5, and 7, respectivelv. Thus the problem can be solved by Theorem 2; 
that is, there is an Euler path. One is shown in Figure 6.32. 


D (Outside) 
Figure 6.32 


Theorems 1 and 2 are examples of existence theorems. They guarantee the 
existence of an object of a certain type, but they give no information on how to 
produce the object. There is one hint in Theorem 2(b) about how to proceed. In 
Figure 6.33, an Euler path must begin (or end) at B and end (or begin) at C. The 
paths B, A, D,C,A, B,C and B, C, A, B, A, D, C are two Euler paths for the graph. 
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Figure 6.33 D c 


We next give an algorithm that produces an Euler circuit for a connected 
graph with no vertices of odd degree. We require an additional definition before 
stating the algorithm. An edge {y,, v,} is a bridge in a connected graph G if delet- 
ing {v;, v,} would create a disconnected graph. For example, in the graph of Figure 
6.4, {B, E} is a bridge. 

Fleury’s Algorithm: Let G = (V, E, y) be aconnected graph with each ver- 
tex of even degree. 


STEP 1. Select a member v of V as the beginning vertex for the circuit. Let 7: v 
designate the beginning of the path to be constructed. 


STEP 2. Suppose that 7: v,u,...,w has been constructed thus far. If at w there is 
only one edge {w, z], extend 7 to 7: v,u,..., w, Zz. Delete {w, z} from E and w 
from V. If at w there are several edges, choose one that is not a bridge to the 
remaining graph, say {w, z]. Extend wto 7:v,u,...,w,z and delete {w, z} from 
E. 


STEP 3. Repeat step 2 until no edges remain in E. 


End of Algorithm 


Example 6. Use Fleury’s algorithm to construct an Euler circuit for the graph 
in Figure 6.34. 


D H 
Figure 6.34 


Solution: According to step 1, we may begin anywhere. Arbitrarily choose 
vertex A. We summarize the results of applying step 2 repeatedly in Table 6.1. 
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Table 6.1 

Current Path Next Edge Reasoning 

wA {4, 8: No edge from A is a bridge. Choose any one. 
w: A,B {B,C} Only one edge from B remains. 

7: A,B,C {C, A> No edge from C is a bridge. Choose any one. 
w:A,B,CA {A, D} No edge from A is a bridge. Choose any one. 
aw: A, B,C,A,D {D, Cc Only one edge from D remains. 

a: A, B,C, A, D,C {C, £} Only one edge from C remains. 

mw. A,B,C,A,D,C,E {E, G. No edge from E is a bridge. Choose any one. 
w:A,B,C,A,D,C,E,G {G, 7} {A, G} is a bridge. Choose {G, F} or {G, H}. 
aw. A,B,C,A,D,C,E,G,F {F, E} Only one edge from F remains. 
w:A,B,C,A,D,C,E,G,F,E {E, 17 Only one edge from EZ remains. 

aw: A, B,C,A,D,C, E,G, F, E,H {H, G} Only one edge from H remains. 

aw: A, B,C, A, D, C, E, G, F, E, H, G {G, A} Only one edge from G remains. 

aw: A, B,C,A,D,C, E,G,F,E,H,G,A 


The edges in Figure 6.35 have been numbered in the order of their choice in 
applying step 2. In several places, other choices could have been made. In gener- 
al, if a graph has an Euler circuit, it is likely to have several different Euler 
circuits. Sd 


Figure 6.35 


EXERCISE SET 6.2 


In Exercises | through 4, tell whether the graph L (a) A B D 
has an Euler circuit, an Euler path but no Euler 
circuit, or neither. Give reasons for your choice. Cc 


Figure 6.36 
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(b) 4 B 


(b) 
x 
D E 
Figure 6.37 
2. (a) 


B 

C) Figure 6.41 
D 4, (a) 

Figure 6.38 


1 2 
(b) Figure 6.42 
(b) 
3 4 5 
: eae : 
Figure 6.39 


Figure 6.43 
3. (a) 
In Exercises 5 and 6, tell if it is possible to trace 
the figure without lifting the pencil. Explain 
your reasoning. 


Figure 6.40 


Figure 6,44 
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6. 


a 


8. 


10. 


Figure 6.45 


Use Fleury’s algorithm to produce an Euler cir- 
cuit for the graph in Figure 6.46. 


Figure 6,46 


Use Fleury’s algorithm to produce an Euler cir- 
cuit for the graph in Figure 6.44. 


An art museum has arranged its current exhibi- 
tion in the five rooms shown in Figure 6.47. Is 
there a way to tour the exhibit so that you pass 
through each door exactly once? If so, give a 


sketch of your tour. 


pee) 


Figure 6.47 


At the door of an historical mansion, you 
receive a copy of the floor plan for the house 
(Figure 6.48). Is it possible to visit every room 
in the house by passing through each door 
exactly once? Explain your reasoning. 


ol 


Figure 6.48 


In Exercises 11 through 13 (Figures 6.49 
through 6.51), no Euler circuit is possible for 
the graph given. For each graph, show the mini- 
mum number of edges that would need to be 
traveled twice in order to travel every edge and 
return to the starting vertex. 


11. 


Figure 6.49 


Figure 6.50 


13. 


Figure 6.51 
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14, Use Fleury’s algorithm to find an Euler circuit 
for the modified version of the graph in Figure 
6.50. Begin at the upper-left corner. 


15. Use Fleury’s algorithm to find an Euler circuit 
for the modified version of the graph in Figure 
6.51. Begin at A. 


6.3. Hamiltonian Paths and Circuits 


We turn now to the second category of graph problems in which the task is to 
visit each vertex exactly once, with the exception of the beginning vertex if it 
must also be the last vertex. For example, such a path would be useful to some- 
one who must service a set of vending machines on a regular basis. Each vending 
machine could be represented by a vertex, 

A Hamiltonian path is a path that contains each vertex exactly once. A 
Hamiltonian circuit is a circuit that contains each vertex exactly once except for 
the first vertex, which is also the last. This sort of path is named for the mathe- 
matician Sir William Hamilton, who developed and marketed a game consisting 
of a wooden graph in the shape of a regular dodecahedron and instructions to 
find what we have called a Hamiltonian circuit. A planar version of this solid is 
shown in Figure 6.52(a), with a Hamiltonian circuit (one of many) shown in 
Figure 6.52(b) by the consecutively numbered vertices. 


(a) (b) 
Figure 6.52 


Example 1. Consider the graph in Figure 6.53. The path a, b, c, d, e is a 
Hamiltonian path because it contains each vertex exactly once. It is not hard to 
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see, however, that there is no Hamiltonian circuit for this graph. For the graph 
shown in Figure 6.54, the path A, D, C, B, A (choosing either edge from B to A) 
is a Hamiltonian circuit. In Figures 6.55 and 6.56, no Hamiltonian path is possi- 


ble. (Verify this.) ad 
d 
c ’» e A B 
b 
a D C 
Figure 6.53 Figure 6.54 
A B 
2 5 
E Cc 
3 
4 
D 
l 6 
Figure 6.55 Figure 6.56 


Example 2. Any complete graph K, has Hamiltonian circuits. In fact, starting at 
any vertex, you can visit the other vertices sequentially in any desired order. 


Questions analogous to those about Euler paths and circuits can be asked 
about Hamiltonian paths and circuits. Is it possible to determine whether a 
Hamiltonian path or circuit exists? If there must be a Hamiltonian path or cir- 
cuit, is there an efficient way to fiad it? Surprisingly, considering Theorems 1 and 
2 of Section 6.2, the first question about Hamiltonian paths and circuits has not 
been completely answered. However, we can make several observations based on 
the examples. 

It is clear that loops and multiple edges are of no use in finding 
Hamiltonian circuits, since loops could not be used, and only one edge can be 
used between any two vertices. Thus we will suppose that any graph we mention 
has no loops or multiple edges. 

If a graph G on n vertices lias a Hamiltonian circuit, then G must have at 
least n edges. 

We now state some partial answers that say if a graph G has “enough” 
edges, a Hamiltonian circuit can be found. Let G be a connected graph with n ver- 


Sec.6.3. Hamiltonian Paths and Circuits 215 


tices, n > 2, and no loops or multiple edges. These are again existence statements; 
no method for constructing a Hamiltonian circuit is given. 


Theorem 1. G Aas a Hamiltonian circuit if for any two vertices u and v of G that 
are not adjacent, the degree of u plus the degree of v is greater than or equal to n. 
a 


We omit the proof of this result, but from it we can prove the following: 


Corollary. G has a Hamiltonian circuit if each vertex has degree greater than or 
equal to n/2. 


Proof: The sum of the degrees of any two vertices is at least} + 3 =n, 
so the hypotheses of Theorem 1 hold. 4 


Theorem 2. Let the number of edges of G be m. Then G has a Hamiltonian cir- 
cuit ifm = 5 (n? — 3n + 6) (recall that n is the number of vertices). 


Proof: Suppose that u and v are any two vertices of G that are not adja- 
cent. We write deg(u) for the degree of u. Let H be the graph produced by 
eliminating u and v from G along with any edges that have u or v as end 
points. Then H has n — 2 vertices and m — deg(u) — deg(v) edges (one 
more edge would have been removed if u and v had been adjacent). The 
maximum number of edges that H could possibly have is ,,_.C, (see Section 
3.2). This happens when there is an edge connecting every distinct pair of 
vertices. Thus the number of edges of H is at most 


ae: a =3) or se 5n + 6). 


n~ 202 


We then have m — deg(u) — deg(v) = 5(n? — 5n + 6). Therefore, 
deg(u) + deg(v) = m — 5(n* — 5n + 6). By the hypothesis of the theorem, 


1 1 
deg(u) + deg(v) = ra —3n+6)- a —5n+6)=n. 
Thus the result follows from Theorem 1. ¢ 


Example 3. The converses of the theorems given above are not true; that is, the 
conditions given are sufficient, but not necessary, for the conclusion. Consider the 
graph represented by Figure 6.57. Here , the number of vertices, is 8, each ver- 
tex has degree 2, and deg(u) + deg(v) = 4 for every pair of nonadjacent vertices 
u and v. The total number of edges is also 8. Thus the premises of Theorems 1 and 
2 fail to be satisfied, but there are certainly Hamiltonian circuits for this graph. 


The problem we have been considering has a number of important varia- 
tions. In one case, the edges may have weights representing distance, cost, and the 
like. The problem is then to find a Hamiltonian circuit (or path) for which the 
total sum of weights in the path is a minimum. For example, the vertices might 
represent cities; the edges, lines of transportation; and the weight of an edge, the 
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cost of travel along that edge. This version of the problem is often called the 
Traveling Salesperson problem. Another important category of problems involv- 
ing graphs with weights assigned to edges is discussed in Section 8.5. 


A 
He” B 
G Cc 
F D 
‘. 
E 
Figure 6.57 


EXERCISE SET 6.3 


In Exercises 1 through 6 (Figures 6.58 through 3.1 2 
6.41), determine whether the graph shown has a 
Hamiltonian circuit, a Hamiltonian path but no 
Hamiltonian circuit, or neither. If the graph has 
a Hamiltonian circuit, give the circuit. 


es e Figure 6.60 


fi 


\\ 


D E —<_— 
Figure 6.58 Figure 6.61 


2. B 


D 
Figure 6.59 Figure 6.62 
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6. 
Figure 6.63 
Figure 6.67 
In Exercises 7 through 10 (Figures 6.64 In Exercises 11 through 14, find a Hamiltonian 
through 6.67), find a Hamiltonian circuit for circuit of minimal weight for the graph repre- 
the graph given. sented by the given figure. 
7 11. Figure 6.64. 
B 5) D 6 F 
5 
3 G 
ee Se 4 
A 2 ¢ . H 
12. Figure 6.65. 
Figure 6.64 
13. Figure 6,66. 
B 14. Figure 6.67. 


15. (a) Find a Hamiltonian circuit of minimal 
weight for the graph represented by Figure 
6.64 if you must begin and end at D. 
(b) Find a Hamiltonian circuit of minimal 
weight for the graph represented by Figure 
6.65 if you must begin and end at F. 


Figure 6.65 
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6.4, Coloring Graphs 


Suppose that G = (V, E, y) is a graph with no multiple edges, and C = {c,,c,,...,¢,} 
is any set of x “colors.” Any function f: V > C is called a coloring of the graph G 
using x colors (or using the colors of C). For each vertex v, f(v) is the color of v. 
As we usually present a graph pictorially, so we also think of a coloring in the 
intuitive way of simply painting each vertex with a color from C. However, graph 
coloring problems have a wide variety of practical applications in which “color” 
may have almost any meaning. For example, if the graph represents a connected 
grid of cities, each city can be marked with the name of the airline having the 
most flights to and from that city. In this case, the vertices are cities and the col- 
ors are airline names. Other examples are given later. 

A coloring is proper if any two adjacent vertices v and w have different colors. 


Example 1. Let C = {r,w,b, y| so that x = 4. Figure 6.68 shows a graph G prop- 
erly colored with the colors from C in two different ways, one using three colors 
from C and one using all four. We show the colors as labels, which helps to 
explain why we avoid giving names to vertices. There are many ways to color this 
graph properly with three or four colors, but it is not hard to see that this cannot 
be done with two or fewer colors. (Experiment to convince yourself that this is 
true.) Sd 


\Y 


Figure 6.68 


The smallest number of colors needed to produce a proper coloring of a 
graph G is called the chromatic number of G, denoted by X(G). For the graph G 
of Figure 6.68, our discussion leads us to believe that X(G) = 3. 

Of the many problems that can be viewed as graph coloring problems, one 
of the oldest is the map coloring problem. Consider the map shown in Figure 6.69. 

A coloring of a map is a way to color each region (country, state, county, 
province, etc.) so that no two distinct regions sharing a common border have the 
same color. The map coloring problem is to find the smallest number of colors 
that can be used. We can view this problem as the proper graph coloring problem 
as follows. Given a map M, construct a graph Gy, with one vertex for each region 
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and an edge connecting any two vertices whose corresponding regions share a 
common boundary. Then the proper colorings of Gy correspond exactly to the 
colorings of M. 


Figure 6.69 


Example 2. Consider the map f shown in Figure 6.69. Then G,,, is represented 


by Figure 6.70. of 
A B D F 
Cc E 
Figure 6.70 


The map coloring problem dates back to the mid-nineteenth century and 
has been an active object of research at various times since then. A conjecture 
was that four colors are always enough to color any map drawn on a plane. This 
conjecture was proved to be true in 1976 with the aid of computer computations 
performed on almost 2000 configurations of graphs. There is still no proof known 
that does not depend on computer checking. 

The graph corresponding to a map is planar, meaning that it can be drawn 
in a plane so that no edges cross except at vertices. Figure 6.70 illustrates the pla- 
narity of the graph corresponding to the map of Figure 6.69. The graph K; is not 
planar, so graph coloring problems are more general than map coloring prob- 
lems. In particular, we will see that five colors are required to color K,. 

Graph coloring problems also arise from counting problems. 


Example 3. Fifteen different foods are to be held in refrigerated compartments 
within the same refrigerator. Some of them can be kept together, but other foods 
must be kept apart. For example, spicy meats and cheeses should be kept sepa- 
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rate from bland meats and vegetables. Apples, eggs, and onions should be isolated 
or they will contaminate many cther foods. Butter, margarine, and cream cheese 
can be kept together, but must be separated from foods with strong odors. We can 
construct a graph G as follows. Construct one vertex for each food and connect 
two with an edge if they must be kept in separate compartments in the refriger- 
ator. Then ¥(G) is the smallest number of separate containers needed to store 
the 15 foods properly. Sd 


A similar method could be used to calculate the minimum number of labo- 
ratory drawers needed to store chemicals if we need to separate chemicals that 
will react with one another if stored close to each other. 


Chromatic Polynomials 


Closely related to the problem of computing X(G) is the problem of computing 
the total number of different proper colorings of a graph G using a set C = 
{c,, C,..-,¢,} of colors. 

If G is a graph and x = 0 is an integer, let P(x) be the number of ways to 
properly color G using x or fewer colors. Since P(x) is a definite number for each 
x, we see that P, is a function. What may not be obvious is that P, is a polyno- 
mial in x. This can be shown in general and is clearly seen in the examples of this 
section. We call P, the chromatic polynomial of G. 


Example 4. Consider the linear graph L, defined in Section 6.1 and shown in 
Figure 6.9. Suppose that we have. x colors. The first vertex can be colored with any 
color. No matter how this is done, the second can be colored with any color that 
was not chosen for vertex 1. Thus there are x — 1 choices for vertex 2. Vertex 3 
can then be colored with any of the x — 1 colors not used for vertex 2. A similar 
result holds for vertex 4. By the multiplication principle of counting (Section 3.1), 
the total number of proper colorings is x(x — 1)°. Thus P,(@) =x - ly. ¢ 


We see from Example 4 thet P, (0) = 0, P,,(1) = 0, and P, (2) = 2. Thus 
there are no proper colorings of L, using zero colors (obviously) or one color, 
and there are two using two colors. From this we see that X(L,) = 2. This con- 
nection holds in general, and we have the following principle. 

If G is a graph with no multiple edges, and P, is the chromatic polynomial 
of G, then X(G) is the smallest positive integer x for which P(x) # 0. 

An argument similar to the one given in Example 4 shows that for L,, 
n=1,P, (x) = x(x — 1)” ~! Thus, by the above principle, X(L,,) = 2 for every n. 


Example 5. For any n = 1, consider the complete graph K,, defined in Section 
6.1. Suppose that we again have x colors to use in coloring K,,. If x < n, no proper 
coloring is possible. So let x = n. Vertex v, can be colored with any of the x col- 
ors. For vertex v,, only x — 1 remain since v, is connected to v,. We can only color 
v3 with x — 2 colors, since v3 is connected to v, and v, and so the colors of v, and 
v, cannot be used again. Similarly, only x — 3 colors remain for v,, and so on. 
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Again using the multiplication principle of counting, we find that Py (x) = 
x(x — 1)(x — 2)--- (x —n + 1). This shows that x(K,,) = n. Note that if there are 
at least n colors, then Py (x) is the number of permutations of x objects taken n 
at a time (see Section 3.1). ¢ 


Suppose that a graph G is not connected and that G, and G, are two com- 
ponents of G. This means that no vertex in G, is connected to any vertex in G,. 
Thus any coloring of G, can be paired with any coloring of G,. This can be 
extended to any number of components, so the multiplication principle of count- 
ing gives the following result. 


Theorem 1. /f G is a disconnected graph with components G,, G,,...,G,,, then 
Pg(x) = Pax) Pe,(x) ++ Pg, (x), the product of the chromatic polynomials for each 
component. ¢ 


Example 6. Let G be the graph shown in Figure 6.6. Then G has two compo- 
nents, each of which is K,. The chromatic polynomial of K; is x(x — 1)(x — 2), 
x = 3. Thus, by Theorem 1, P(x) = x?(x — 1)°(x — 2)?. We see that X(G) = 3, and 
that the number of distinct ways to color G using three colors is P,(3) = 36. If x 
is 4, then the total number of proper colorings of G is 4° - 3 - 2? or 576. o 


Example 7. Consider the discrete graph D,, of Section 6.1, having n vertices and 
no edges. All n components are single points. The chromatic polynomial of a sin- 
gle point is x, so, by Theorem 1, Pp) (x) = x". Thus X(D,,) = 1 as can also be seen 
directly. Sd 


There is a useful theorem for computing chromatic polynomials using the 
subgraph and quotient graph constructions of Section 6.1. Let G = {V, E, y} be a 
graph with no multiple edges, and let e € E, say e = {a, b}. As in Section 6.1, let 
G, be the subgraph of G obtained by deleting e, and let G° be the quotient graph 
of G obtained by merging the end points of e. Then we have the following result. 


Theorem 2. With the preceding notation and using x colors, 


P(x) = Po) — Poe(x) 


Proof: Consider all the proper colorings of G,. They are of two types, 
those for which a and b have different colors and those for which a and 6 
have the same color. Now a coloring of the first type is also a proper coloring 
for G, since a and b are connected in G, and this coloring gives them dif- 
ferent colors, On the other hand, a coloring of G, of the second type corre- 
sponds to a proper coloring of G’. In fact, since a and b are combined in G*, 
they must have the same color there. All other vertices of G, have the same 
connections as in G. Thus we have proved that Fy (x) = Pg(x) + Pge(x) or 


Po) = Po (x) — Pge(x). 


Example 8. Let us compute P,(x) for the graph G shown in Figure 6.71, 
using the edge e. Then G° is K, and G, has two components, one being a single 
point and the other being K,. By Theorem 1, P, (x) = x + x(@@ — 1)(« - 2) = 
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x°(x ~ 1)(x — 2), if x = 2. Also, Poe(x) = x(x — 1)(x — 2). Thus, by Theorem 2, we 
see that P,(x) = x°(x — 1)(x — 2) — x(x — 1)(x — 2) or x(x — 1)?(x — 2). Clearly, 
Po(1) = P,(2) = 0, and P,(3) = 12. This shows that X(G) = 3. Sd 


A 


Figure 6.71 


EXERCISE SET 6.4 


In Exercises 1 through 4 (Figures 6.72 through 3. 
6.75), construct a graph for the map given as is 
shown in Example 2. 


1. 


Eee 


cr RI 


Figure 6.74 


Figure 6.72 


eos 


Figure 6.73 Figure 6.75 


In Exercises 5 and 6 (Figures 6.76 through 
6.79), determine the chromatic number of the 
graph by inspection. 


5. (a) | | (b) ; 


Figure 6.76 —_- Figure 6.77 


6. b V 
(a) (b) Va 1 


V6 


Vs V4 
Figure 6.78 Figure 6.79 


In Exercises 7 through 10 (Figures 6.80 through 
6.83), find the chromatic polynomial P, for the 
given graph and use P, to find X(G). 


Figure 6.80 
Figure 6.81 


KEY IDEAS FOR REVIEW 


@ Graph: G = (V,E, y), where V is a finite set 
of objects, called vertices, E is a set of 
objects, called edges, and y is a function that 
assigns to each edge a two-element subset of 
Vv. 

# Degree of a vertex: number of edges at the 
vertex 

@ Adjacent vertices: pair of vertices that define 
an edge 


10. 


11. 


14, 
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Figure 6.82 


Figure 6.83 


Find P, and x(G) for the graph G of the map 
in Exercise 1. 


. Find Pg and X(G) for the graph G of the map 


in Exercise 3. 


. Find P; and X(G) for the graph G given in 


Exercise 5(a). Do the results confirm your orig- 
inal answer for Exercise 5(a)? 


Find P, and X(G) for the graph G of the map 
in Exercise 4, Consider using Theorem 2 to do 
this. 


. Prove by mathematical induction that 


Py (x) = x(x - 1" VnZ2l. 


Path: list of vertices such that consecutive 
vertices define edges and no edge is used 
more than once 

Circuit: path that begins and ends at the 
same vertex 

Simple path or circuit: see page 199 
Connected graph: There is a path from any 
vertex to any other vertex. 

Subgraph: see page 200 
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Euler path (circuit): path (circuit) that con- 
tains every edge of the graph exactly once 

¢@ Theorem: (a) If a graph G has a vertex of odd 
degree, there can be no Euler circuit in G, 
(b) If G is a connected graph and every ver- 
tex has even degree, then there is an Euler 
circuit in G. 

@ Theorem: (a) Ifa graph G has more than two 
vertices of odd degree, then there can be no 
Euler path in G. (b) If G is connected and 
has exactly two vertices of odd degree, there 


is 


an Euler path in G. 


@ Bridge: edge whose deletion would cause the 
graph to become disconnected 

@ Fleury’s algorithm: see page 209 

@ Hamiltonian path: path that includes each 
vertex of the graph exactly once 

@ Hamiltonian circuit: circuit that includes 
each vertex exactly once except for the first 
vertex, which is also the last 

@ Theorem: Let G be a graph on n vertices 


CODING EXERCISES 


For each of the following, write the requested pro- 
gram or subroutine in pseudocode (as described in 
Appendix A) or in a programming language that 
you know. Test your code either with a paper-and- 
pencil trace or with a computer run. 


In each of these exercises assume that a graph ts 
defined by G = (V, E, y). 


L 


Write a function that, given G and an ele- 
ment v of V, will return the degree of v. 


Write a subroutine that will determine if two 
vertices of G are adjacent. 


3. 


wa 


with no loops or multiple edges, n > 2. If for 
any two vertices u and v of G, the degree of 
u plus the degree of v is at least n, then G has 
a Hamiltonian circuit. 

Theorem: Let G be a graph on n vertices 
that have no loops or multiple edges, n > 2. 
If the number of edges in G is at least 3(n2 — 
3n + 6), then G has a Hamiltonian circuit. 
Coloring of a graph using x colors: see page 
218 

Proper coloring of a graph: Adjacent edges 
have different colors. 

Chromatic number of a graph G, X(G): 
smallest number of colors needed for a 
proper coloring of G 

Planar graph: graph that can be drawn in a 
plane with no crossing edges 

Chromatic polynomial of a graph G, Po: 
number of proper colorings of G in terms of 
the number of colors available 


Write code for Fleury’s algorithm. 


Write a subroutine that with input a list of 
vertices of G reports whether or not that list 
defines a valid path that is a Hamiltonian 
path. 


Modify your code for Exercise 4 so that the 
subroutine checks for Hamiltonian circuits. 


CHAPTE 


Prerequisite: Chapter 4 


In this chapter we study partially ordered sets, including lattices and Boolean 
algebras. These structures are useful in set theory, algebra, sorting and searching, 
and, especially in the case of Boolean algebras, in the construction of logical rep- 
resentations for computer circuits. 


7.1. Partially Ordered Sets (Posets) 


A relation R on a set A is called a partial order if R is reflexive, antisymmetric, 
and transitive. The set A together with the partial order R is called a partially 
ordered set, or simply a poset, and we will denote this poset by (A, R). If there is 
no possibility of confusion about the partial order, we may refer to the poset sim- 
ply as A, rather than (A, R). 
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Example 1. Let A be a collection of subsets of a set S. The relation C of set 
inclusion is a partial order on .A, so (A, C) is a poset. 4 


Example 2. Let Z* be the set of positive integers. The usual relation < (less 
than or equal to) is a partial order on Z*, as is = (greater than or equal to). 


Example 3. The relation of divisibility (a R 6 if and only if a | 6) is a partial 
order on Z*. a 
Example 4. Let ® be the set of all equivalence relations on a set A. Since ® con- 
sists of subsets of A X A, & is a partially ordered set under the partial order of 
set containment. If R and § are equivalence relations on A, the same property 
may be expressed in relational notation as follows. 


RC Sifand onlyifx Ry implies xSyforallx,yinA. 
Then (&, C) is a poset. a 


Example 5. The relation < on Z* is not a partial order, since it is not reflexive. 
Sd 


Example 6. Let R bea partial order on a set A, and let R~' be the inverse rela- 
tion of R. Then R™! is also a partial order. To see this, we recall the characteriza- 
tions of reflexive, antisymmetric, and transitive given in Section 4.4. If R has these 
three properties, then A C R, KR 1 R™! C A,and R? € R. By taking inverses, we 
have A=A'CRIR'N(R')'=R'NRCA,and (RY CR“, 50, by 
Section 4.4, R~' is reflexive, antisymmetric, and transitive. Thus R~! is also a par- 
tial order. The poset (A, R~') is called the dual of the poset (A, R), and the par- 
tial order R! is called the dual of the partial order R. Sd 


The most familiar partial orders are the relations = and = on Z and R. For 
this reason, when speaking in general of a partial order R on a set A, we shall 
often use the symbols = or = for R. This makes the properties of R more famil- 
iar and easier to remember. Thus the reader may see the symbol = used for many 
different partial orders on different sets. Do not mistake this to mean that these 
relations are all the same or that they have anything to do with the familiar rela- 
tion = on Z or R. If it becomes absolutely necessary to distinguish partial orders 
from one another, we may also use symbols such as =,, =’, =,, =’, and so on, to 
denote partial orders. 

We will observe the following convention. Whenever (A, =<) is a poset, we 
will always use the symbol = for the partial order <~', and thus (A, =) will be 
the dual poset. Similarly, the dual of poset (A, =,) will be denoted by (A, =,), and 
the dual of the poset (B, =’) will be denoted by (B, =’). Again, this convention 
is to remind us of the familiar dual posets (Z, =) and (Z, =), as well as the posets 
(R, =) and (R, =). 

If (A, =) is a poset, the elements a and b of A are said to be comparable if 


astb or bsSa. 


Sec. 7.1 Partially Ordered Sets (Posets) 227 


Observe that in a partially ordered set every pair of elements need not be com- 
parable. For example, consider the poset in Example 3. The elements 2 and 7 are 
not comparable; since 2 4 7 and 7 4 2. Thus the word “partial” in partially 
ordered set means that some elements may not be comparable. If every pair of 
elements in a poset A is comparable, we say that A is a linearly ordered set, and 
the partial order is called a linear order. We also say that A is a chain. 


Example 7. The poset of Example 2 is linearly ordered. Sd 
The following theorem is sometimes useful, since it shows how to construct 
a new poset from given posets. 


Theorem 1. [f (A, =) and (B, S) are posets, then (A X B, =) is a poset, with par- 
tial order = defined by 


(a, b) = (a’,b’) ifasa’inA and b=b’inB. 


Note that the symbol = is being used to denote three distinct partial orders. The 
reader should find it easy to determine which of the three is meant at any time. 


Proof: If (a,b) € A X B, then (a,b) = (a,b) sincea Sain A andb sb 
in B,so = satisfies the reflexive property in A X B. Now suppose that 
(a, b) = (a’, b’) and (a’, b’) = (a,b), where a and a’ € A and band b’ € B. 
Then 


, 


asa’ and a’=a inA 
and 
b=b’ and W’=b in B. 


Since A and B are posets, the antisymmetry of the partial orders in A and 
B implies that 


a=a’ and b=B’. 


Hence < satisfies the antisymmetric property in A X B. 
Finally, suppose that 


(a,b) S(a',b’) and (a’,b’) = (a”, b”), 
where a,a’,a” & A, and b, b’,b” & B. Then 
axa’ and a’sa’”, 
so a = a”, by the transitive property of the partial order in A. Similarly, 
b=b’ and Bb’ Sb’, 
so b = b”, by the transitive property of the partial order in B. Hence 
(a, b) = (a”, b”). 


Consequently, the transitive property holds for the partial order in A Xx B, 
and we conclude that A x B is poset. Sd 
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The partial order = defined on the Cartesian product A X B as above is 
called the product partial order. 

If (A, =) is a poset, we say that a < b ifa = b, but a # b. Suppose now that 
(A, S) and (B, ss) are posets. In Theorem 1 we have defined the product partial 
order on A X B. Another useful partial order on A X B, denoted by <, is defined 
as follows: 


(a,b) <(a’,b’) ita<a’ or ifa=a’andbdsbd’. 


This ordering is called lexicographic, or “dictionary” order. The ordering of the 
elements in the first coordinate dominates, except in case of “ties,” when atten- 
tion passes on to the second coordinate. If (A, =) and (B, S) are linearly ordered 
sets, then the lexicographic order < on A X B is also a linear order. 


Example 8. Let A = R, with the usual ordering <. Then the plane R? = R x R 
may be given lexicographic order. This is illustrated in Figure 7.1. We see that the 
plane is linearly ordered by lexicographic order. Each vertical line has the usual 
order, and points on one line are less than any points on a line farther to the right. 
Thus, in Figure 7.1, p, < p., p, ~< p3, and p, < p3. 


Figure 7.1 


Lexicographic ordering is easily extended to Cartesian products A, X A, X 
-+ x A, as follows: 
(4), 49,....4,) < (aj, a3,...,a,) if and only if 
a,<aj or 
a,=aj; and @,<aj or 
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a=aj, a@=a5, and a,<aj or... 


— , va , eee o o 
a=4, =a), ..., a,;=a,_, and a, Say. 


Thus the first coordinate dominates except for equality, in which case we con- 
sider the second coordinate. If equality holds again, we pass to the next coordi- 
nate, and so on. 


Example 9. Let S = {a, b,..., z} be the ordinary alphabet, linearly ordered in 
the usual way (a = b,b =c,...,y Sz). Then S” = § X § X--: X S (n factors) 
can be identified with the set of all words having length n. Lexicographic order 
on S" has the property that if w, < w, (w,,w, © S"), then w, would precede w, in 
a dictionary listing. This fact accounts for the name of the ordering. 

Thus park < part, help < hind, jump < mump.The third is true since j < m; 
the second, since h = h,e < i; and the first is true since p = p,a =a,r=r, 
k<t. Sa 


If S is a poset, we can extend lexicographic order to S* (see Section 1.3) in 
the following way. 

If x = aja,---a, and y = 6,b,--- b, are in S* with n = k, we say that x < y 
if (a,,...,a@,) < (b,,...,6,) in S” under lexicographic ordering of S”. In other 
words, we chop off to the length of the shortest word and then compare. 

In the previous paragraph, we use the fact that the n-tuple (a,, a,...,4,) © 
5S", and the string a,a, ‘+: a, © S* are really the same sequence of length n, writ- 
ten in two different notations, The notations differ for historical reasons, and we 
will use them interchangeably depending on context. 


Example 10. Let S be {a,,..., z}, ordered as usual. Then S* is the set of all pos- 
sible “words” of any length, whether such words are meaningful or not. 
Thus we have 


help < helping 
in S* since 
help < help 
in S*, Similarly, we have 
helper < helping 
since 
helper < helpin 
in S°, As the example 
help < helping 


shows, this order includes prefix order; that is, any word is greater than all of its 
prefixes (beginning parts). This is also the way that words occur in the dictionary. 
Thus we have dictionary ordering again, but this time for words of any finite 
length. ° 
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Since a partial order is a relation, we can look at the digraph of any partial 
order on a finite set. We shall find that the digraphs of partial orders can be rep- 
resented in a simpler manner than those of general relations. The following the- 
orem provides the first result in this direction. 


Theorem 2. The digraph of a partial order has no cycle of length greater than 1. 


Proof: Suppose that the digraph of the partial order = on the set A con- 
tains a cycle of length n = 2. Then there exist distinct elements a), a),..., 
a, © A such that 


Q@, S Ay, by S Gy,...,4,_, = a,,a, Say. 


By the transitivity of the partial order, used n — 1 times, a, = a,,. By anti- 
symmetry, @, = a, and a. =a, imply that a, = a), a contradiction to the 
assumption that @,,a),...,4@,, are distinct. « 


Hasse Diagrams 


Let A be a finite set. Theorem 2 has shown that the digraph of a partial order on 
A has only cycles of length 1. Indeed, since a partial order is reflexive, every ver- 
tex in the digraph of the partial order is contained in a cycle of length 1. To sim- 
plify matters, we shall delete all such cycles from the digraph. Thus the digraph 
shown in Figure 7.2(a) would be drawn as shown in Figure 7.2(b). 


oy © 


€. @) 


(a) (b) 
Figure 7.2 
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We shall also eliminate all edges that are implied by the transitive prop- 
erty. Thus, if a = b and b = c, it follows that a < c. In this case, we omit the edge 
from a to c; however, we do draw the edges from a to b and from b to c. For exam- 
ple, the digraph shown in Figure 7.3(a) would be drawn as shown in Figure 7.3(b). 
We also agree to draw the digraph of a partial order with all edges pointing 
upward, so that arrows may be omitted from the edges. Finally, we replace the cir- 
cles representing the vertices by dots. Thus the diagram shown in Figure 7.4 gives 
the final form of the digraph shown in Figure 7.2(a). The resulting diagram of a 
partial order, much simpler than its digraph, is called the Hasse diagram of the 
partial order of the poset. Since the Hasse diagram completely describes the asso- 
ciated partial order, we shall find it to be a very useful tool. Do not confuse Hasse 
diagrams with graphs (Chapter 6). Both are simplified ways of representing dif- 
ferent types of digraphs. 


(b) a 
Figure 7.3 Figure 7.4 


Example 11. Let A = {1,2,3, 4, 12}. Consider the partial order of divisibility on 
A. That is, if a and b € A,a Sb if and only if a| b. Draw the Hasse diagram of 
the poset (A, =). 


Solution: The Hasse diagram is shown in Figure 7.5. To emphasize the 
simplicity of the Hasse diagram, we show in Figure 7.6 the digraph of the 
poset in Figure 7.5. . 


Example 12. Let S = {a,b,c} and A = P(S). Draw the Hasse diagram of the 
poset A with the partial order C (set inclusion). 


Solution: We first determine A, obtaining 
A = (©, {a}, {5}, {c}, a, 5), {a,c}, (B, c}, (a,b, cH}. 
The Hasse diagram can then be drawn as shown in Figure 7.7. « 


Observe that the Hasse diagram of a finite linearly ordered set is always of 
the form shown in Figure 7.8. 

It is easily seen that if (A, =) is a poset and (A, =) is the dual poset, the 
Hasse diagram of (A, =) is just the Hasse diagram of (A, =) turned upside down. 
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Figure 7.5 Figure 7.6 
{a, b,c} 
\ 
{b, c} {a, c} 
(a,b) / 
{c} 
\ 
{b} {a} 
“a 
@ 
Figure 7.7 


f 
Figure 7.8 
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Example 13. Figure 7.9(a) shows the Hasse diagram of a poset (A, <), where 
A = {a, b,c, d, e, f}. Figure 7.9(b) shows the Hasse diagram of the dual poset 
(A, =). Notice that, as mentioned above, each of these diagrams can be con- 


structed by turning the other upside down. Sd 
f a b c 
d e 
d e 
a b c f 
(a) (b) 
Figure 7.9 


Topological Sorting 


If A is a poset with partial order <=, we sometimes need to find a linear order 
< for the set A that will merely be an extension of the given partial order in the 
sense that if a = b, then a < b. The process of constructing a linear order such as 
< is called topological sorting. This problem might arise when we have to enter 
a finite poset A into a computer. The elements of A must be entered in some 
order, and we might want them entered so that the partial order is preserved. 
That is, if a <= b, then a is entered before b. A topological sorting < will give an 
order of entry of the elements that meets this condition. 


Example 14. Give a topological sorting for the poset whose Hasse diagram is 
shown in Figure 7.10. 


Solution: The partial order < whose Hasse diagram is shown in Figure 
7.11(a) is clearly a linear order. It is easy to see that every pair in = is also 
in the order <,so < is a topological sorting of the partial order =. Figure 
7.11(b) and (c) show two other solutions to this problem. 


As Example 14 shows, there are many ways of topologically sorting a given 
poset. An algorithm for generating topological sortings will be given in Section 
7.2. 
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f f 
f 
g & 
f e 
d c 
e e 
d b 
& b 
c & 
d 
b c 
c 
a a a 
a (a) (b) (c) 
Figure 7.10 Figure 7.11 


Isomorphism 


Let (A, =) and (A’, <) be posets and let f: A — A’ be a one-to-one correspon- 
dence between A and A’. The function fis called an isomorphism from (A, =) to 
(A’, =’) if, for any a and b in A, 


asb ifandonlyif f(a) =’ f(b). 


If f: A — A’ is an isomorphism, we say that (A, =) and (A’, =’) are isomorphic 
posets. 


Example 15. Let A be the set Z* of positive integers, and let = be the usual par- 
tial order on A (see Example 2). Let A’ be the set of positive even integers, and 
let =’ be the usual partial order on A’. The function f: A — A’ given by 


f(a) = 2a 
is an isomorphism from (A, =) to (A’, =’). 

First, f is one to one since, if f(a) = f(b), then 2a = 2b, so a = b. Next, 
Dom(f) = A,so fis everywhere defined. Finally, if c € A’, then c = 2a for some 
a € Z'; therefore, c = f(a). This shows that f is onto, so we see that f is a one- 
to-one correspondence. Finally, if a and b are elements of A, then it is clear that 
a = bif and only if 2a = 2b. Thus f is an isomorphism. Sa 


Suppose that f: A —-> A’ is an isomorphism from a poset (A, <) to a poset 
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(A’, =’). Suppose also that B is a subset of A, and B’ = f(B) is the corresponding 
subset of A’. Then we see from the definition of isomorphism that the following 
general principle must hold. 


Theorem 3 (Principle of Correspondence). Jf the elements of B have any prop- 
erty relating to one another or to other elements of A, and if this property can be 
defined entirely in terms of the relation =, then the elements of B’ must possess 
exactly the same property, defined in terms of =’. 5 


Example 16. Let (A, =) be the poset whose Hasse diagram is shown in Figure 
7.12, and suppose that f is an isomorphism from (A, =) to some other poset 
(A’, S’). Note first that d = x for any x in A (later we will call an element such as 
da “least element” of A). Then the corresponding element f(d) in A’ must sat- 
isfy the property f(d) =’ y for all y in A’. As another example, note that a # b 
and b € a. Such a pair is called incomparable in A. It then follows from the prin- 


ciple of correspondence that f(a) and f(b) must be incomparable in A’. ¢ 
a b 
c 
d 
Figure 7.12 


For a finite poset, one of the objects that is defined entirely in terms of the 
partial order is its Hasse diagram. It follows from the principle of correspondence 
that two finite isomorphic posets must have the same Hasse diagrams. 

To be precise, let (A, =) and (A’, =’) be finite posets, let f: A — A’ be a one- 
to-one correspondence, and let H be any Hasse diagram of (A, =). Then 


1. If fis an isomorphism and each label a of H is replaced by f(a), then H 
will become a Hasse diagram for (A’, =’). 


Conversely, 


2. If H becomes a Hasse diagram for (A’, <’), whenever each label a is 
replaced by f(a), then f is an isomorphism. 


Example 17, Let A = (1, 2, 3, 6} and let = be the relation | (divides). Figure 
7.13(a) shows a Hasse diagram for (A, =). Let A’ = P({a, b}) = {©, {a}, {5}, {a, b}}, 
and let <’ be set containment, C. If f: A > A’ is defined by 


fI)= 9,  f(2)= {a}, FB) = (b}, (6) = (a, 5}, 


then it is easily seen that f is a one-to-one correspondence. If each label a € A of 
the Hasse diagram is replaced by f(a), the result is as shown in Figure 7.13(b). 
Since this is clearly a Hasse diagram for (A’, =’), the function f is an isomor- 
phism. Sd 
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6 {a, b} 
2 3 {a} {b} 
1 © 
(a) (b) 
Figure 7.13 
1, Determine whether the relation R is a partial 6. A = {a,b, c,d, e}, R = {(a, a), (0, b), (c,c), (a, €), 
order on the set A. (c, d), (c, e), (a, 4), (d, d), (a, €), (b,c), (b, d), 
(a) A = Z,and aR b if and only if a = 2b. (b, e), (e, e)) 
(b) A = Z,and a R b if and only if 5° | a. 
(c) A = Z,anda Rb if and only if a = b* for 7. Describe the ordered pairs in the relation 
some k € Z*. Note that k depends on a and b. determined by the Hasse diagram on the set A 
(d) A = R,anda R b if and only ifas b. in Figures 7.14 and 7.15. 


(a) A= {1, 2,3, 4} 
2. Determine whether the relation R is a linear 

order on the set A. 4 
(a) A = R, anda R b if and only if a = b. 
(b) A = R, anda R b if and only if a= b. 
(c) A = P(S), where S is a set. The relation R is 3 

set inclusion. 
(d) A = R X R, and (a, b) R (a’, b’) if and only 

ifa sa’ and b = Bb’, where S is the usual 


partial order on R. 2 1 
Figure 7.14 
3. On the set A = {a, b,c}, find all partial orders = 
in which a = b, (b) A= {1, 2,3, 4} 
4 


4. What can you say about the relation R ona set 
A if R is a partial order and an equivalence 


relation? 3 
In Exercises 5 and 6, determine the Hasse dia- 
gram of the relation R. 2 


5. A= (1, 2, 3, 4), R= {(, 1), (1, 2), (2, 2), Q, 4), 
(1, 3), (3, 3), (3, 4), (1, 4), (4,.4)} 1 
Figure 7.15 
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In Exercises 8 and 9, determine the Hasse dia- 10. Determine the Hasse diagram of the relation 
gram of the partial order having the given on A = (1,2, 3, 4,5} whose matrix is shown. 
digraph (Figures 7.16 and 7.17). 11111 
o1ii1ii1 
(aay JO O 1 1 1 
000 1 1 
000 0 1 
1031 1 41 
o 111i 
(b) 0 0 1 11 
000 1 0 
0000 1 


11. Determine the matrix of the partial order whose 
Hasse diagram is given (Figures 7.18 and 7.19). 


{a)2 3 4. 5 


Figure 7.16 


1 
Figure 7.18 


(b) 4 5 


: Zs 


2 3 
1 
(3) fo Figure 7.19 


12. Let A = Z* X Z* have lexicographic order. 
Mark each of the following as true or false. 


(a) (2,12) < (5,3) (b) (3,6) < (3,24) 
@) ) (c) (4,8) < (4,6) — (d) (15, 92) < (12,3) 
In Exercises 13 and 14, consider the partial 


order of divisibility on the set A. Draw the Hasse 
diagram of the poset and determine which 


v) posets are linearly ordered. 


13. (a) A = (1,2,3,5,6, 10, 15, 30] 
Figure 7.17 (b) A = (2,4, 8, 16, 32} 
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14, (a) A = (3,6, 12, 36,72] 
(b) A = {1, 2,3, 4,5, 6, 10, 12, 15, 30, 60} 


15. Let A = {L, A, B, C, E, O, M, P, S| have the 
usual alphabetical order, where LJ represents a 
“blank” character and (] = x for allx € A. 
Arrange the following in lexicographic order 
(as elements of A X A X A X A). 


(a) MOP (b) MOPE 
(c) CAPO) (d) MAP] 
(e) BASE (f) ACEO 


(g) MACE (h) CAPE 
In Exercises 16 and 17, draw the Hasse diagram 
of a topological sorting of the given poset 


(Figures 7.20 and 7.21), 


16. 8 


1 
Figure 7.20 


Figure 7.21 


18. 


19 


. 


20 


. 


21. 


22. 


23 


24, 


25 


If (A, =) is a poset and A’ is a subset of A, 
show that (A’, =’) is also a poset, where =’ is 
the restriction of = to A’. 


Show that if R is a linear order on the set A, 
then R™! is also a linear order on A. 


A relation R on a set A is called a quasiorder if 

it is transitive and irreflexive. Let A = P(S) be 

the power set of a set 5S, and consider the fol- 

lowing relation R on A: U R T if and only if 

U G T (proper containment). Show that R is a 
quasi-order, 


Let A = {x |x is areal number and -5 = x = 
20}. Show that the usual relation < is a quasi- 
order (see Exercise 20) on A. 


If R is a quasiorder on A (see Exercise 20), 
show that R7! is also a quasiorder. 


Let B = (2,3, 6, 9, 12, 18,24] and let A = B x B. 
Define the following relation on A: (a, b) < 

(a’, b’) if and only if a/ a’ and b = b’, where = 
is the usual partial order. Show that < is a par- 
tial order. 


Let A = {1,2,3,5,6, 10, 15, 30} and consider the 

partial order < of divisibility on A. That is, 

define a = 6 to mean that a|b. Let A’ = P(S), 

where S = {e, f, g}, be the poset with partial 

order C. Show that (A, =) and (4’, C) are 
isomorphic. 


Let A = {1,2, 4, 8} and let < be the partial 
order of divisibility on A. Let A’ = (0,1, 2,3} 
and let =’ be the usual relation “less than or 
equal to” on integers. Show that (A, =) and 
(A’, =’) are isomorphic posets. 
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7.2, Extremal Elements of Partially Ordered Sets 


Certain elements in a poset are of special importance for many of the properties 
and applications of posets. In this section we discuss these elements, and in later 
sections we shall see the important role played by them. In this section we con- 
sider a poset (A, =) with partial order =. 

An element a € A is called a maximal element of A if there is no element 
cin A such that a < c (see Section 7.1). An element b € A is called a minimal ele- 
ment of A if there is no element c in A such that c < b. 

It follows immediately that, if (A, <) is a poset and (A, =) is its dual poset, 
an element a € A is a maximal element of (A, =) if and only if a is a minimal ele- 
ment of (A, =). Also, a is a minimal element of (A, =) if and only if it is a maxi- 
mal element of (A, S). 


Example 1. Consider the poset A whose Hasse diagram is shown in Figure 7.22. 
The elements aj, a,, and a; are maximal elements of A, and the elements b,, b,, 
and b, are minimal elements. Observe that, since there is no line between b, and 


b;, we can conclude neither that b, = b, nor that b, = b3. 5 
43 
ay ay 
by bg 
bs 
Figure 7.22 


Example 2. Let A be the poset of nonnegative real numbers with the usual par- 
tial order =. Then 0 is a minimal element of A. There are no maximal elements 
of A. a 


Example 3. The poset Z with the usual partial order = has no maximal ele- 
ments and has no minimal elements. ¢ 


Theorem 1. Let A bea finite nonempty poset with partial order =. Then A has at 
least one maximal element and at least one minimal element. 


Proof: Let abe any element of A. If a is not maximal, we can find an ele- 
ment a, € A such that a < a,. If a, is not maximal, we can find an element 
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a, © A such that a, < a). This argument cannot be continued indefinitely, 
since A is a finite set. Thus we eventually obtain the finite chain 


a@<a,<a,< ++ <a, <a, 


which cannot be extended. Hence we cannot have a, < b for any b € A,so 
a, is a maximal element of (A, =). 

The same argument says that the dual poset (A, =) has a maximal ele- 
ment, so (A, =) has a mirimal element. 


By using the concept of a minimal element, we can give an algorithm for 
finding a topological sorting of a given finite poset (A, =). We remark first that if 
a € A and B = A — {a}, then B is also a poset under the restriction of = to 
B X B (see Section 4.2). We then have the following algorithm, which produces a 
linear array named SORT. We assume that SORT is ordered by increasing index, 
that is, SORT[1] < SORT(2] < ---.The relation < on A defined in this way is a 
topological sorting of (A, <). 


Algorithm for finding a topological sorting of a finite poset (A, =). 
Step 1. Choose a minimal element a of A. 
STEP 2, Make a the next entry of SORT and replace A with A — {a}. 
STEP 3. Repeat steps 1 and 2 waril A = { }. 
End of Algorithm 


Example 4. Let A = {a, b, c,d, e}, and let the Hasse diagram of a partial order 
= on A be as shown in Figure 7.23(a). A minimal element of this poset is the 
vertex labeled d (we could also have chosen e). We put d in SORT[1] and in 
Figure 7.23(b) we show the Hasse diagram of A — {d}. A minimal element of the 
new A is e, so e becomes SORT|2], and A — {e} is shown in Figure 7.23(c). This 
process continues until we have exhausted A and filled SORT. Figure 7.23(f) 
shows the completed array SORT and the Hasse diagram of the poset corre- 
sponding to SORT. This is a topological sorting of (A, <). ¢ 


An element a € A is called a greatest element of A if x = a for all x € A. 
An element a € A is called a least element of A if a <x for allx € A. 

As before, an element a of (A, S) is a greatest (or least) element if and only 
if it is a least (or greatest) element of (A, =). 


Example 5. Consider the poset defined in Example 2. Then 0 is a least element; 
there is no greatest element. ¢ 


Example 6. Let S = {a, b, c| and consider the poset A = P(S) defined in 
Example 12 of Section 7.1. The empty set is a least element of A, and the set S is 
a greatest element of A. a 


Example 7. The poset Z with the usual partial order has neither a least nor a 
greatest element. 5 


Theorem 2. A poset has at most one greatest element and at most one least 
element. 


@s 
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Proof: Suppose that a and b are greatest elements of a poset A. Then, 
since b is a greatest element, we have a < 5. Similarly, since a is a greatest 
element, we have b = a. Hence a = b by the antisymmetry property. Thus, 
if the poset has a greatest element, it only has one such element. Since this 
fact is true for all posets, the dual poset (A, =) has at most one greatest ele- 


ment, so (A, =) also has at most one least element. ¢ 
a b a b 
c c 
SORT 
(Lo euesied 
d e e 
(a) (b) 
a b 
e e 
SORT SORT 
eae lea ead 
(c) (d) 
a 
b 
SORT SORT 


ny 


fefele fo] | fefelefofe| 
(e) 


Figure 7.23 (f) 


The greatest element of a poset, if it exists, is denoted by J and is often called 
the unit element. Similarly, the least element of a poset, if it exists, is denoted by 0 
and is often called the zero element. 
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Consider a poset A and < subset B of A. An element a € A is called an 
upper bound of B if b <a for all b € B. Anelementa € A is called a lower bound 
of Bifa = b for allb € B. 


Example 8. Consider the poset A = {a, b,c, d,e, f,g, h}, whose Hasse diagram is 
shown in Figure 7.24. Find all upper and lower bounds of the following subsets of 
A: (a) B, = {a,b}; (b) B, = {c, de}. 


h 
J 8 
d e€ 
c 
G b 
Figure 7.24 


Solution 
(a) B, has no lower bounds; its upper bounds are c, d, e, f, g, and A. 


(b) The upper bounds of #, are fg, and h; its lower bounds are c, a, and b. 
¢ 


As Example 8 shows, a subset B of a poset may or may not have upper or 
lower bounds (in A). Moreover, an upper or lower bound of B may or may not 
belong to B itself. 

Let A be a poset and B a subset of A. An element a € A is called a least 
upper bound (LUB) of B if a is an upper bound of B and a S a’, whenever a’ is 
an upper bound of B. Thus a = LUB (B) if b < a for all b € B, and if whenever 
a’ € A is also an upper bound of B, then a = a’. 

Similarly, an element a € A is called a greatest lower bound (GLB) of B if a 
is a lower bound of B and a’ = a, whenever a’ is a lower bound of B. Thus a = 
GLB (B) if a = b for all b € B, and if whenever a’ € A is also a lower bound of 
B,then a’ < a. 

As usual, upper bounds in (.4, =) correspond to lower bounds in (A, =) (for 
the same set of elements), ancl lower bounds in (A, =) correspond to upper 
bounds in (A, =). Similar statements hold for greatest lower bounds and least 
upper bounds. 


Example 9. Let A be the poset considered in Example 8 with subsets B, and B, 
as defined in that example. Find all least upper bounds and all greatest lower 
bounds of (a) B,; (b) B,. 
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Solution 
(a) Since B, has no lower bounds, it has no greatest lower bounds. 
However, 
LUB (B,) =. 
(b) Since the lower bounds of B, are c,a, and b, we find that 
GLB (B,) = c. 


The upper bounds of B, are f, g, and h. Since f and g are not comparable, we 
conclude that B, has no least upper bound. Sd 


Theorem 3. Let (A, <) be a poset. Then a subset B of A has at most one LUB 
and at most one GLB. 


Proof: The proof is similar to the proof of Theorem 2. o 


We conclude this section with some remarks about LUB and GLB in a 
finite poset A, as viewed from the Hasse diagram of A. Let B = {b,, b,,...,b,}. If 
a = LUB (B), then a is the first vertex that can be reached from b,, b,,...,b, by 
upward paths. Similarly, if a = GLB (8B), then a is the first vertex that can be 
reached from b,, b»,..., 5, by downward paths. 


Example 10. Let A = (1,2,3,4,5,...,11]} be the poset whose Hasse diagram is 
shown in Figure 7.25. Find the LUB and the GLB of B = {6, 7, 10}, if they exist. 


Solution: Exploring all upward paths from vertices 6, 7, and 10, we find 
that LUB (B) = 10. Similarly, by examining all downward paths from 6, 7, 


and 10, we find that GLB (B) = 4. Sd 
11 
10 
9 
8 
5 
4 
2 
1 

Figure 7.25 


The next result follows immediately from the principle of correspondence 
(see Section 7.1). 


Theorem 4. Suppose that (A, =) and (A’, =’) are isomorphic posets under the 
isomorphism f: A> A’. 
(a) If a is a maximal (minimal) element of (A, =), then f(a) is a maximal 
(minimal) element of (A’, =’). 
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(b) If a is the greatest (leust) element of (A, =), then f(a) is the greatest 
(least) element of (A’, <5’). 

(c) If ais an upper bound (lower bound, least upper bound, greatest lower 
bound) of a subset B cf A, then f(a) is an upper bound (lower bound, 
least upper bound, greatest lower bound) for the subset f(B) of A’. 

(d) If every subset of (A, =<) has a LUB (GLB), then every subset of (A’, =’) 
has a LUB (GLB). 


Example 11. Show that the posets (A, =) and (A’, =’), whose Hasse diagrams 
are shown in Figure 7.26 (a) and (b), respectively, are not isomorphic. 


a a’ Bb 
b c c’ 
(a) (b) 
Figure 7.26 


Solution: The two posets are not isomorphic because (A, =) has a great- 
est element a, while (A’, =’) does not have a greatest element. We could 
also argue that they are not isomorphic because (A, =) does not have a 
least element, while (A’, =:’) does have a least element. a 


EXERCISE SET 7.2 


In Exercises 1 through 4 determine all maximal 2 (a) ¢ f 
and minimal elements of the poset. 
L (a) 3 5 
4 
2 
1 6 
Figure 7.27 
(b) f g 
d e : 
Figure 7.29 
a b c 


Figure 7.28 
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6. (a) 4 5 


(b) 4 7 
3 6 3 
5 
2 8 
1 2 
Figure 7.33 
1 9 


b 5 
Figure 7.30 e) 


3. (a) A = R with the usual partial order =. 
(b) A = {x | xis areal number and 0 <x <1} 
with the usual partial order =. 4 


4. (a) A = {x|xis areal number and0 <x <1} 2 3 
with the usual partial order S. 
(b) A = {2, 3,4, 6, 8, 24, 48} with the partial 
order of divisibility. Figure 7.3 1 
In Exercises 5 through 8, determine the greatest 7G a = eavaceal aumberanto See) 
and least elements, if they exist, of the poset. with the usual partial order =. 


(b) A = {x |x is a real number and 0S x = 1} 
5. (a) f With the usual partial order =. 
8. (a) A = [2,4,6,8, 12, 18, 24, 36, 72} with the 
d e partial order of divisibility. 
(b) A = {2, 3, 4, 6, 12, 18, 24, 36} with the partial 
order of divisibility. 
b c In Exercises 9 through 18 find, if they exist, (a) 
all upper bounds of B;(b) all lower bounds of 
B; (c) the least upper bound of B; (d) the great- 
a est lower bound of B. 
Figure 7.31 9. 8 h 
(b) € 
d d e 
c 
a b 
B={o4 
: 4 {c, d, e} 


Fiqure 7.32 Figure 7.35 
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10. 4 5 
x 
1 2 


B= {1,2,3,4, 5} 
Figure 7.36 
11. 

f 

e 

d 

c 

b 

a 
B= {, G d} 
Figure 7.37 


7.3. Lattices 


12. 5 8 
6 
4 9 
7 
1 2 


B= {3, 4, 6} 
Figure 7.38 
13. (A, =) is the poset in Exercise 9; B = {b, g, h}. 
14. (a) (A, =) is the poset in Exercise 12; 
B= {4, 6,9}. 


(b) (A, =) is the poset in Exercise 12; 
B= (3,4, 8). 


15. A = Rand = denotes the usual partial order; 
B = {x|x isa real number and 1 < x < 2}. 


16, A = Rand = denotes the usual partial order; 
B = {x |x is a real number and 1 = x < 2}. 


17. A = P ({a,b,c}) and = denotes the partial 
order of containment; B = P ({a, b}). 


18, A = {2,3,4,6, 8, 12,24, 48] and = denotes the 
partial order of divisibility; B = (4, 6, 12}. 


19. Construct the Hasse diagram of a topological 
sorting of the poset whose Hasse diagram is 
shown in Figure 7,35. Use the algorithm SORT. 


20. Construct the Hasse diagram of a topological 
sorting of the poset whose Hasse diagram is 


shown in Figure 7.36. Use the algorithm SORT. 


A lattice is a poset (L, =) in which every subset {a, b} consisting of two elements 
has a least upper bound and a greatest lower bound. We denote LUB ({a, 5}) by 
a\/ 6 and call it the join of a and b. Similarly, we denote GLB ({a, b}) bya Ab 
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and call it the meet of a and b. Lattice structures often appear in computing and 
mathematical applications. Observe that a lattice is a mathematical structure as 
described in Section 1.6, with two binary operations, join and meet. 


Example 1. Let § be a set and let L = P(S). As we have seen, C, containment, 
is a partial order on L. Let A and B belong to the poset (L, C). Then A \/ B is 
the set A U B.To see this, note that AC A U B,B C A U B,and,if A C C and 
BCC, then it follows that A U B C C. Similarly, we can show that the element 
A/\B in (L, C) is the set A M B. Lis lattice. ¢ 


Example 2. Consider the poset (Z*, <), where for a and b in Z*,a = bif and 
only ifa|b.Then L isa lattice in which the join and meet of a and D are their least 
common multiple and greatest common divisor, respectively (see Section 1.4). 
That is, 


a\/b=LCM (a,b) and aAb=GCD (a,b). o 


Example 3. Let” be a positive integer and let D,, be the set of all positive divi- 
sors of 7. Then D,, is a lattice under the relation of divisibility as considered in 
Example 2. Thus, ifn = 20, we have D4) = (1,2, 4, 5, 10, 20}. The Hasse diagram 
of D,) is shown in Figure 7.39(a). If n = 30, we have Dy = [1, 2, 3, 5, 6, 10, 15, 30}. 


The Hasse diagram of D,, is shown in Figure 7.39(b). 5 
20 30 
4 10 6 4 15 
> <> 
2 5 2 5 
1 1 
Do Do 
(a) (b) 
Figure 7.39 


Example 4. Which of the Hasse diagrams in Figure 7.40 represent lattices? 


Solution: Hasse diagrams (a), (b), (d), and (e) represent lattices. Diagram 
(c) does not represent a lattice because f \/ g does not exist. Diagram (f) 
does not represent a lattice because neither d /\ e nor b \/ c exist. Diagram 
(g) does not represent a lattice because c /\ d does not exist. Sd 


Example 5. We have already observed in Example 4 of Section 7.1 that the set 
® of all equivalence relations on a set A is a poset under the partial order of set 
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containment. We can now conclude that & is a lattice where the meet of the 
equivalence relations R and S is their intersection R M S and their join is (R U S)*, 


the transitive closure of their union (see Section 4.8). ° 
f g 
e 
d 
- e c d 
¢ 
b d d 
b b 
a b c 
a 
a 
a 
(a) (b) (c) (d) 
f é 
\ 
e 
d e c d 
a 
b d ey 
b c 
a 
a 
a 
(e) 1) (g) 
Figure 7.40 


Let (L, <) be a poset and let (L, =) be the dual poset. If (L, <) is a lattice, 
we can show that (L, =) is also a lattice. In fact, for any a and BD in L, the least 
upper bound of a and b in (L, <) is equal to the greatest lower bound of a and b 
in (L, =). Similarly, the greatest lower bound of @ and b in (L, <) is equal to the 
least upper bound of a and 5 in (., =). If L is a finite set, this property can easily 
be seen by examining the Hasse diagrams of the poset and its dual. 


Example 6. Let S be a set and 1, = P(S). Then (ZL, C) is a lattice, and its dual 
lattice is (L, D), where C is “contained in” and 2D is “contains.” The discussion 
preceding this example then shows that in the poset (L, D) the join A \/ Bis the 
set A M B,and the meet A /\ B is the set A U B. ¢ 
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Theorem 1. /f (L,, <) and (L,, =) are lattices, then (L, =) is a lattice, where 
L = L, X L,, and the partial order = of L is the product partial order. 


Proof: We denote the join and meet in L, by \/, and /\, respectively, and 
the join and meet in L, by \/, and /,, respectively. We already know from 
Theorem 1 of Section 7.1 that L is a poset. We now need to show that if 
(@,, b,) and (4, b,) & L, then (a), by) VV (a, by) and (a, by) \ (@, b,) exist 
in L. We leave it as an exercise to verify that 


(4,, By) V (@, Bs) = (@ Vi 2; By V2 9) 
(a,, by) \ (@, by) = (a Ay ay, By Ay by). 
Thus L is a lattice. 5 


Example 7. Let L, and L, be the lattices shown in Figure 7.41(a) and Wk 
respectively. Then Ee L, X L, is the lattice shown in Figure 7.41(c). 


(h, hy) 
I Ih 
(h, a) (h, b) 
: : <> 
04, 0,, 6 
0; 0> (0, a) (0,, 6) 
(0;, 02) 
Ly In L=L1,xXI, 
(a) (b) (c) 
Figure 7.41 


Let (L, =) be a lattice. A nonempty subset S of L is called a sublattice of L 
ifa\yb © Sanda/\b € S whenever a © SandbeES. 


Example 8. The lattice D, of all positive divisors of n (see Example 3) is a sub- 
lattice of the lattice Z* under the relation of divisibility (see Example 2). ¢ 


Example 9. Consider the lattice L shown in Figure 7.42(a). The partially ordered 
subset S, shown in Figure 7.42(b) is not a sublattice of L since a /\ b € S, and 
a\/b € S,. The partially ordered subset S, in Figure 7.42(c) is not a sublattice 
of L since a\/ b € S,. Observe, however, that S, is a lattice when considered 
as a poset by itself. The partially ordered subset S, in Figure 7.42(d) is a sub- 
lattice of L. ° 
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I I I 
e f fy e f c 
a b a b a b <> 
0 0 0 


(a) (b) (c) (d) 
Figure 7.42 


Isomorphic Lattices 


If f: L, > L, is an isomorphism from the poset (L,, =) to the poset (L,, =,), then 
Theorem 4 of Section 7.2 tells us that L, is a lattice if and only if L, is a lattice. 
In fact, if a and b are elements of L,, then f(a /\ b) = f(a) A f(b) and 
f(a\/ b) = f(a) V f(b). If two lattices are isomorphic, as posets, we say they are 
isomorphic lattices. 


Example 10. Let L be the lattice D,, and let L’ be the lattice P(S) under the 
relation of containment, where S = {a, b}. These posets were discussed in 
Example 16 of Section 7.1, where they were shown to be isomorphic. Thus, since 
both are lattices, they are isomorphic lattices. ¢ 


If f: A > B is a one-to-one correspondence from a lattice (A, <) to a set B, 
then we can use the function f to define a partial order =’ on B. If 6, and 6, are 
in B, then b, = f(a,) and b, = f(a,) for some unique elements a, and a, of A. 

Define b, =’ b, Gin B) if a <a, (in A). If A and B are finite, then we can 
describe this process geometrically as follows. Construct the Hasse diagram for 
(A, =). Then replace each label « by the corresponding element f(a) of B. The 
result is the Hasse diagram of the partial order =’ on B. 

When B is given the partial order <’, f will be an isomorphism from the 
poset (A, =) to the poset (B, =’). To see this, note that f is already assumed to be 
a one-to-one correspondence. The definition of =’ states that, for any a, and a, in 
A, a, < a, if and only if f(a.) =’ f(a,). Thus f is an isomorphism. Since (A, <) is 
a lattice, so is (B, =’), and they are isomorphic lattices. 


Example 11. If A is a set, let R be the set of all equivalence relations on A and 
let II be the set of all partitions on A. In Example 13 of Section 5.1 we con- 
structed a one-to-one correspondence f from & to II. In Example 4 of Section 7.1, 
we considered the partial order C: on &. From this partial order we can construct, 
using f as explained above, a partial order =’ on II. By construction, if P, and ¥, 
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are partitions of A, and R, and R,, respectively, are the equivalence relations cor- 
responding to these partitions, then ?, = ¥, will mean that R,; C R,. Since we 
showed in Example 5 that (®, C) is a lattice, and we know that f is an isomor- 
phism, it follows that (II, =’) is also a lattice. In Exercise 29 we describe the par- 
tial order <’ directly in terms of the partitions themselves. Sd 


Properties of Lattices 


Before proving a number of properties of lattices, we recall the meaning of 
a\/banda/\b. 


1. a=a\/bandb=a\/b;a\/ bis an upper bound of a and b. 

2. Ifa=<candb<=c,thena\/b<c;,a\ bis the least upper bound of a 
and b. 

V. a/b saanda/\b <= b;a/ bisa lower bound of a and b. 

2’. Ife <aandc = b,thenc <a/\b;a/ bis the greatest lower bound of 
aand b, 


Theorem 2. Let L be a lattice. Then for every a and b in L, 
(a) a\/ b = bif and only ifa = b. 
(b) a/b = aif and only ifa = b. 
(c) a/\ b = aif and only ifa\y b = b. 


Proof: (a) Suppose that a \/ b = b. Since a = a\/ b = b,we havea =b. 
Conversely, if a = b, then, since b = b, b is an upper bound of a and b; so by 
definition of least upper bound we have a \/ b = b. Since a \/ b is an upper 
bound, b <a\/ b,soa\/ b = b. 

(b) The proof is analogous to the proof of part (a), and we leave it as an 
exercise for the reader. 

(c) The proof follows from parts (a) and (b). Sd 


Example 12. Let L be a linearly ordered set. If a and b € L, then either a = b 
or b <a. It follows from Theorem 2 that L is a lattice, since every pair of elements 
has a least upper bound and a greatest lower bound. ¢ 


Theorem 3. Let L be a lattice. Then 


1. (a) a\va=a ; 
(ieee Idempotent Properties 

2. (a)aVb=bVa : F 
(b) aAb=bAa Commutative Properties 

3d aV(bYo=(ayvbrve ade, . 
(b) aA (bc) = (ab) Ac Associative Properties 
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4. (a) av (ab) =a 
(by) ANG bree Absorption Properties 


Proof 

1. The statements follow from the definition of LUB and GLB. 

2. The definition of LUB and GLB treat a and b symmetrically, so the 

results follow. 

3. (a) From the definition of LUB, we have a = a \/ (b Vc) and 
bVcsa\/ (b\/ c). Moreover, b = b\/c andc =b \/c,s0, 
by transitivity, b =< a\/ (b Vc) andc Sa\ (b \V c). Thus 
a\/ (b/c) is an upper bound of a and b, so by definition of 
least upper bound we have 


aVbsav/(b\ oc). 
Since a \/ (by c) is an upper bound of a \V b and c, we obtain 
(av b)vesxavbvc). 
Similarly, a \V (b VV c) = (a V b) Vc. By the antisymmetry of 
<, property 3a) follows. 

(b) The proof is analogous to the proof of part (a) and we omit it. 
4, (a) Since a /\ b < a anda <a, we see that a is an upper bound of 
a/\banda;soa\/ (a/\b) = a. On the other hand, by the def- 

inition of LUB, we havea <a\/ (a/\b),soa\/ (a/b) = a. 
(b) The proof is analogous to the proof of part (a) and we omit it. 
0 


It follows from property 3 that we can write a \/ (b \/ c) and (a \V b) Vc 
merely as a \/ b \/ c, and similarly for a \ b /\ c. Moreover, we can write 


LUB ({a;,@,...,@,}) a8 a, \/ a),\/-+'\/a, 
GLB ({a,, a)....,4,}) as a,ANa,/---/\a,, 


since we can show by induction that these joins and meets are independent 
of the grouping of the terms. 


Theorem 4. Let L be a lattice. Then, for every a,b, and c in L, 
1. Ifa = b, then 
(a)aVcsbVec. 
(b) a\c<=bNe. 
2.a%candb<cifand only ifa\/b <c. 
3.c Saandc & bifand only ife sab. 
4. Ifa<sb andc =d, then 
(a)aVcsbVd. 
(b) aNc<bAd. 


Proof: The proof is left as. an exercise. ° 
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Special Types of Lattices 


A lattice L is said to be bounded if it has a greatest element / and a least element 
0 (see Section 7.2). 


Example 13. The lattice Z* under the partial order of divisibility, as defined in 
Example 2, is not a bounded lattice since it has a least element, the number 1, but 
no greatest element. ° 


Example 14. The lattice Z under the partial order = is not bounded since it has 
neither a greatest nor a least element. Sd 


Example 15. The lattice P(S) of all subsets of a set S, as defined in Example 1, 
is bounded. Its greatest element is § and its least element is 0. ° 


If L is a bounded lattice, then for alla € A 


Osa=l 
aV0O=a, a/0=0 
aVl=l, a/\I=a. 


Theorem 5. Let L = (a,,a,...,a,,} be a finite lattice. Then L is bounded. 


Proof: The greatest element of L is a, \/ a, \/--:\/ a,, and its least ele- 
ment is a, /\a,/\:+:/\a,,. ° 


A lattice L is called distributive if for any elements a, b, and c in L we have 
the following distributive properties: 


laN(bVc)=(aNb)V (ao). 
2aV(bAc)=(Vb)A(av ec). 


If L is not distributive, we say that L is nondistributive. 

We leave it as an exercise to show that the distributive property holds when 
any two of the elements a, b, or c are equal or when any one of the elements is 0 
or J. This observation reduces the number of cases that must be checked in veri- 
fying that a distributive property holds. However, verification of a distributive 
property is generally a tedious task. 


Example 16. For a set S, the lattice P(S) is distributive, since union and inter- 
section (the join and meet, respectively) each satisfy the distributive property as 
shown in Section 1.2. 


Example 17. The lattice shown in Figure 7.43 is distributive, as can be seen by 
verifying the distributive properties for all ordered triples chosen from the ele- 
ments a, b,c, and d. 4 
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I I 
b d 
. 1 
a c b Cc a c 
N 
0 0 0 
(ay (b) 
Figure 7.43 Figure 7.44 


Example 18. Show that the lattices pictured in Figure 7.44 are nondistributive. 


Solution 
(a) We have 


ai\(b\Vic)=aNl=a 
while 
(aNb)V (anc) =bV0=b. 
(b) Observe that 
a/\(b\Vic)=aNl=a 
while 
(@@QAb\V(aNc =0V0=0. o 
The nondistributive lattices discussed in Example 18 are useful for showing 


that a given lattice is nondistributive, as the following theorem, whose proof we 
omit, asserts. 


Theorem6. A Jattice L is nondistributive if and only if it contains a sublattice that 
is isomorphic to one of the two lattices of Example 18. o 


Theorem 6 can be used quite efficiently by inspecting the Hasse diagram of L. 
Let L be a bounded lattice with greatest element J and least element 0, and 
let a € L. An element a’ € L is called a complement of a if 


a\v/a’ =I and a/a'=0. 
Observe that 
0’=T1 and I’ =0. 
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Example 19. The lattice L = P(S) is such that every element has a complement, 
since if A € L, then its set complement A has the properties A \/ A = S and 
ANA =@. Sa 


Example 20. The lattices in Figure 7.44 each have the property that every 
element has a complement. The element c in both cases has two complements, 
aand b. ° 


Example 21. Consider the lattices Dj, and D,) discussed in Example 3 and 
shown in Figure 7.39. Observe that every element in D,, has a complement. For 
example, if a = 5, then a’ = 6. However, the elements 2 and 10 in D,, have no 
complements. ¢ 


Examples 20 and 21 show that an element a in a lattice need not have 
a complement, and it may have more than one complement. However, for a 
bounded distributive lattice, the situation is more restrictive, as shown by the 
following theorem. 


Theorem 7. Let L be a bounded distributive lattice. If a complement exists, it is 
unique. 
Proof: Leta’ and a” be complements of the element a € L. Then 
ava =I, ava" =I 
a/\a'=0, a/\a"’=0. 
Using the distributive laws, we obtain 
a=a\f0=a \/ (aNa’)= (a VayN(a' Va’) 
=(aVa'yAN(a’ Va") 
=IN(a’\Vla")=a'\Va". 


Also, 

a“ =a" \V0=a"V(ala’)=(a" VayN(a’ Va’) 
=(ava")N@ va") 
=I/N\(a’\Va")=a'\Va". 

Hence 


a=a’. 4 


A lattice L is called complemented if it is bounded and if every element in 
L has a complement. 


Example 22. The lattice L = P(S) is complemented. Observe that in this case 
each element of L has a unique complement, which can be seen directly or is 
implied by Theorem 7. Sd 


Example 23. The lattices discussed in Example 20 and shown in Figure 7.44 are 
complemented. In this case, the complements are not unique. ¢ 
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EXERCISE SET 7.3 


In Exercises 1 through 3 (Figures 7.45 through (b) g 
7.50), determine whether the Hasse diagram rep- 
resents a lattice. 
1. (a) i e f 
b c 
a 
Figure 7.48 
Figure 7.45 3. (a) 8 
(b) e f 
e f 
d 
b c 
¢ 
a 
Figure 7.49 
a b 
Figure 7.46 
2. (a) (b) 


g f 
h f d £ 
d e b 
a 
c Figure 7.50 
a b 


4. Is the poset A = {2, 3, 6, 12, 24, 36, 72} under 
Figure 7.47 the relation of divisibility a lattice? 


5. 


7. 


Py 


8. 


9. 


10. 


11. 


15. 


16. 


If L, and L, are the lattices shown in Figure 
7.51, draw the Hasse diagram of L, x L, with 
the product partial order. 


by by 
a a 

Ly Ly 
Figure 7.51 


Let L = P(S) be the lattice of all subsets of a set 
S under the relation of containment. Let T be a 
subset of S. Show that P(T) is a sublattice of L. 


Let L be a lattice and let a and b be elements of 
L such that a S b. The interval {a, b] is defined 
as the set of allx © L such thata =x =b. 
Prove that (a, b] is a sublattice of L. 


Show that a subset of a linearly ordered poset 
is a sublattice. 


Find all sublattices of D,, that contain at least 
five elements. 


Give the Hasse diagrams of all nonisomorphic 
lattices that have one, two, thee, four, or five 
elements. 


Show that if a bounded lattice has two or more 
elements, then 0 # I. 


Prove Theorem 2(b). 


Show that the lattice Z* under the usual partial 
order = is distributive. 


Show that the lattice D, is distributive for any n. 


Show that a linearly ordered poset is a distribu- 
tive lattice. 


Show that a sublattice of a distributive lattice is 
distributive. 


17, 


18. 


19. 


20. 


21. 


22. 


23. 


24, 
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Show that if L, and L, are distributive lattices, 
then L = L, X L, is also distributive, where the 
order of L is the product of the orders in L, 
and L.. 


Is the dual of a distributive lattice also distribu- 
tive? Justify your conclusion. 


Show that if a = (b /\c) for some a, b, and cin 
a poset L, then the distributive properties of a 
lattice are satisfied by a, b, and c. 


Prove that if a and b are elements in a bounded, 
distributive lattice and if a has a complement 
a’, then 


a\/ (a’ Ab) =aVb 
a/(a’\V/b)=aNb 


Let L be a distributive lattice. Show that if there 
exists ana wihha/\x =a/\yanda\/x =a\/y, 
then x = y. 


A lattice is said to be modular if, for all a, b,c, 
a@ <= c implies that a\y (b Ac) = (a\V b) Ac. 
(a) Show that a distributive lattice is modular. 
(b) Show that the lattice shown in Figure 7.52 
is a nondistributive lattice that is modular. 


I 


Figure 7.52 
Find the complement of each element in D,. 


Find the complement of each element in Djqs. 


In Exercises 25 and 26 (Figures 7.53 through 
7.56), determine whether each lattice is distribu- 
tive, complemented, or both. 
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25. (a) 


e 
. & 
b d 
a 
Figure 7.53 
(b) f 
d 
é 
c 
b 
a 
Figure 7.54 
26. (a) @e (b) 
& 
d 
e f 
¢ d 
b c 
b 
a 
a 


Figure 7.55 Figure 7.56 


27. Let L be a bounded lattice with at least two 
elements. Show that no element of L is its own 


complement. 

28. Consider the complemented lattice shown in 
Figure 7.57. Give the complements of each ele- 
ment. 

e 
d 
b c 
a 
Figure 7.57 
29. Let P; = {A;, A>,...}, P. = {B,, B,...} be two 


partitions of a set S. Show that ?, = P, (see the 
definition in Example 11) if and only if each A; 
is contained in some B;. 


30. Let S = {a,b,c} and L = P(S). Prove that 
(L, C) is isomorphic to Dy. 
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7.4. Finite Boolean Algebras 


In this section we discuss a certain type of lattice that has a great many applica- 
tions in computer science. We have seen in Example 6 of Section 7.3 that if S is a 
set, L = P(S), and C is the usual relation of containment, then the poset (L, C) 
is a lattice. These lattices have many properties that are not shared by lattices in 
general. For this reason they are easier to work with, and they play a more impor- 
tant role in various applications. 

We will restrict our attention to the lattices (P(S), C), where S is a finite set, 
and we begin by finding all essentially different examples. 


Theorem 1. Jf S, = (x,,x,,....x,} and S, = {y,,yo...-,Y,) are any two finite sets 
with n elements, then the lattices (P(S,), C) and (P(S,), C) are isomorphic. In par- 
ticular, the Hasse diagrams of these lattices may be drawn identically. 


Proof: Arrange the sets as shown in Figure 7.58 so that each element of 
S, is directly over the correspondingly numbered element in S,. For each 
subset A of S,, let f(A) be the subset of S, consisting of all elements that cor- 
respond to the elements of A. Figure 7.59 shows a typical subset A of S, and 
the corresponding subset f(A) of 55. It is easily seen that the function f, 
described above, is a one-to-one correspondence from subsets of S, to sub- 
sets of S,. Equally clear is the fact that if A and B are any subsets of S,, then 
A C B if and only if f(A) C f(B). We omit the details. Thus the lattices 


(P(S,), G) and (P(S;), C) are isomorphic. ¢ 
A 
| 
Sys xy X2 X3 X4 Xp 
Sy Xy Xp eee Xn 
Soi V1 y2 ¥3 ya Yn 
TS  —_Y 
So: yy Yo ott Vy F(A) 
Figure 7.58 Figure 7.59 


The essential point of this theorem is that the lattice (P(S), C) is completely 
determined as a poset by the number |S| and does not depend in any way on the 
nature of the elements in S. 


Example 1. Figure 7.60(a) and (b) show Hasse diagrams for the lattices 
(P(S), C) and (P(T), C), respectively, where S = {a, b,c} and T = (2, 3, 5}. It is 
clear from this figure that the two lattices are isomorphic. In fact, we see that one 
possible isomorphism f: S + T is given by 
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(a, b, c} {2, 3,5} lil 
7 
{a, b} {b,c} {2,3} {3,5} 110 011 
OD > 
{a} {c} {2} {5} 100 001 
\ 
D © 000 
(a) (b) (ec) 
Figure 7.60 
Ff ({a}) = {2}, F({P}) = {3}, F(te}) = {5}, 
Ff ({a, b}) = {2,3}, F({b, ch) = (3, 5}, F({a, cl) = {2,5}, 
Ff (ia, 6, c}) = {2, 3,5) f(@) = ©. ° 
Thus, for each n = 0,1,2,..., there is only one type of lattice having the 


form (P(S), C). This lattice depends only on n, not on S, and it has 2” elements, as 
was shown in Example 2 of Section 3.1. Recall from Section 1.3 that if a set S has 
n elements, then all subsets of S' can be represented by sequences of 0’s and 1’s of 
length n. We can therefore label the Hasse diagram of a lattice (P(S), C) by such 
sequences. In doing so, we free tne diagram from dependence on a particular set 
S and emphasize the fact that it depends only on n, 


Example 2. Figure 7.60(c) shows how the diagrams that appear in Figure 
7.60(a) and (b) can be labeled by sequences of 0’s and 1’s. This labeling serves 
equally well to describe the lattice of Figure 7.60(a) or (b), or for that matter the 
lattice (P(S), C) that arises from any set S having three elements. ¢ 


If the Hasse diagram of the lattice corresponding to a set with n elements 
is labeled by sequences of 0’s and 1’s of length n, as described above, then the 
resulting lattice is named B,. The properties of the partial order in B, can be 
described directly as follows. If .. = a,a, ---a, and y = b,b,:--b, are two elements 
of B,, then 


1. x = yif and only if a, <= 6, (as numbers 0 or 1) for k = 1,2,...,n. 

2. xy = c,C)+++C,, where c, = min {a,, b;}. 

3. x\Vy =d,d,---d,, where d, = max {a,, b,}. 

4, x has a complement x’ = z,z,-+--zZ,, where z, = lifx, = 0, and z, = Oif 
x, = 1. 


The truth of these statemerits can be seen by noting that (B,, <) is isomor- 
phic with (P(S), C), so each x and y in B, correspond to subsets A and B of S. 
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Then x = y,x Ay,x \/ y, and x’, as defined above, correspond to A C B,A NB, 
A U B, and A (set complement), respectively (verify). Figure 7.61 shows the 
Hasse diagrams of the lattices B, for n = 0,1,2,3. 


111 
1 11 110 O11 
i 91 100 001 

e 
0 00 
000 
n=0 n=l n=2 n=3 
Figure 7.61 


We have seen that each lattice (P(S), C) is isomorphic with B,, where 
n = |S]. Other lattices may also be isomorphic with one of the B, and thus pos- 
sess all the special properties that the B,, possess. 


Example 3. In Example 17 of Section 7.1, we considered the lattice D, consist- 
ing of all positive integer divisors of 6 under the partial order of divisibility. The 
Hasse diagram of D, is shown in that example, and we now see that D, is iso- 
morphic with B,. In fact, f: D, > B, is an isomorphism, where 


fQ)=00, f(2)=10, fG)=01, f(6)=11. ° 


We are therefore led to make the following definition. A finite lattice is 
called a Boolean algebra if it is isomorphic with B, for some nonnegative integer 
n. Thus each B,, is a Boolean algebra and so is each lattice (P(S), C), where S is a 
finite set. Example 3 shows that D, is also a Boolean algebra. 

We will work only with finite posets in this section. For the curious, how- 
ever, we note that there are infinite posets that share all the relevant properties 
of the lattices (P(S), C) (for infinite sets S, of course), but which are not isomor- 
phic with one of these lattices. This necessitates the restriction of our definition 
of Boolean algebra to the finite case, which is sufficient for the applications that 
we present. 


Example 4. Consider the lattices D,) and D,, of all positive integer divisors of 
20 and 30, respectively, under the partial order of divisibility. These posets were 
introduced in Example 3 of Section 7.3, and their Hasse diagrams were shown in 
Figure 7.39. Since D., has five elements and 5 # 2” for any integer n = 0, we con- 
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clude that D,) is not a Boolean algebra. The poset D,) has eight elements, and 
since 8 = 2%, it could be a Boolean algebra. By comparing Figure 7.39(b) and 
Figure 7.61, we see that D, is isomorphic with B,. In fact, we see that the one-to- 
one correspondence f : Dy) — B; defined by 


f(1) = 000, f(2) = 100, f(B) = 010, 
f(S) = 001, f(6)=110, = f(10) = 101, 
f(5)=011, f(30) = 111, 
is an isomorphism. Thus D,, is a Boolean algebra. oa 


If a finite lattice L does not contain 2” elements for some nonnegative inte- 
ger n, we know that L cannot be a Boolean algebra. If |L] = 2”, then L may or 
may not be a Boolean algebra. If L is relatively small, we may be able to compare 
its Hasse diagram with the Hasse diagram of B,,. In this way we saw in Example 
4 that D,) is a Boolean algebra. However, this technique may not be practical 
if L is large. In that case, we nay be able to show that L is a Boolean algebra 
by directly constructing an isomorphism with some B,, or, equivalently, with 
(P(S), C) for some finite set S$. Suppose, for example, that we want to know 
whether a lattice D,, is a Boolean algebra, and we want a method that works no 
matter how large v is. The following theorem gives a partial answer. 


Theorem 2. Let 


n= PP, P2°** Pry 
where the p; are distinct primes. Then D,, is a Boolean algebra. 


Proof: Let S = {p,,po,...,p,j. lf TC S and a; is the product of the primes 
in T, then a; | n. Any divisor of n must be of the form a; for some subset 
T of S (where we let ag =: 1). The reader may verify that if V and T are sub- 
sets of S, V C T if and only if a, | ay. Also, it follows from the proof of 
Theorem 6 of Section 1.4 that ay,7 = a, /\ ay = GCD (ay, a7) and ayy; = 
ay \/ a; = LCM (ay, a). Thus the function f : P(S) > D,, given by f(T) = a, is 
an isomorphism from P(5) to D,,. Since P(S) is a Boolean algebra, so is D,,. 


Sd 
Example 5. Since 210 = 2+3+5+7, 66 = 2+3-> 11, and 646 = 2+ 17- 19, we 
see from Theorem 2 that D1, Dg, and Dy are all Boolean algebras. Sd 


In other cases of large lattices L, we may be able to show that L is not a 
Boolean algebra by showing that the partial order of L does not have the neces- 
sary properties. A Boolean algebra is isomorphic with some B, and therefore 
with some lattice (P(S), C). Thus a Boolean algebra L must be a bounded lattice 
and a complemented lattice (see Section 7.3). In other words, it will have a great- 
est element / corresponding tc the set S and a least element 0 corresponding to 
the subset @. Also, every element x of L will have a complement x’. According to 
Example 16, L must also be distributive. The principle of correspondence (see 
Section 7.1) then tells us that the following rule holds. 


Theorem 3 (Substitution Rule for Boolean Algebras). Any formula involving 
U or N or that holds for arbitrary subsets of a set § will continue to hold for arbi- 
trary elements of a Boolean algebra L if /\ is substituted for and\/forU. @ 
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Example 6. If L is any Boolean algebra and x, y, and z are in L, then the fol- 
lowing three properties hold. 


1.) =x Involution Property 

2. @AyY=xvy 

3. (xVyl =x Ay’ 
This is true by the substitution rule for Boolean algebras, since we know that the 
corresponding formulas 

1. (A)=A. 

2). (ANB) =AUB. 

3. (AUB)=ANB. 


De Morgan’s Laws 


hold for arbitrary subsets A and B of a set S. oa 


In a similar way, we can list other properties that must hold in any Boolean 
algebra by the substitution rule. Next we summarize all the basic properties of 
a Boolean algebra (Z, =) and, next to each one, we list the corresponding prop- 
erty for subsets of a set S. We suppose that x, y, and z are arbitrary elements in 
L, and A, B, and C are arbitrary subsets of S. Also, we denote the greatest and 
least elements of L by J and 0, respectively. 


1. xsyifandonlyifx yy=y. 1. AC BifandonlyifAUB=B. 
2. x=yifandonlyifx\y=x. 2. AC BifandonlyifAN B=A. 


3. (a) x Vx =x. 3’. (a) AUA=A. 
(b) xAx =x. (b) ANA=A. 

4. (a) xVy=yVex. 4’. (a) AUB=BUA. 
(b) xAy=yAx., (b) ANB=BNA. 


5. (a xVOV2=AVyVz 9% (a) AU(BUC)=(AUB)UC. 
(b) x \(y¥Az) = Ay) Az. (bF) AN(BNQ= 


(ANB)NC. 
6. (a) xV(Ay) =x. 6’. (a) AU(ANB)=A. 
(b) xNQ@Vy) =x. (b) AN(AU B)=A. 
7. 0<x <I forallxin L. 7. @CACS for all A in P(S). 
8. (a) x VO =x. 8. (a) AUM=A, 
(b) xA0=80. (b) AND=2. 
9. (a) x VIEL 9. (a) AUS=S. 
(b) xAT=x. (bF) ANS=A. 
10. (a) x \(yV2)= 10. (a) AN(BUC)= 
KAY V (xA2). (AN B)U(ANC). 
(b+) xV (VAz) = (bt) AU(BNC) = 
(xVy AY 2). (AUB)N(AUC),. 
11. Every element x has a unique 11’. Every element A has a unique 
complement x’ satisfying complement A satisfying 
(a) xVxX HL (a) AUA=S. 


(b) xx =0. (bf) ANA=@. 
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12. (a) O=L 12’. (a) B=S. 
(b) I’ =0. (b) S=@. 

13.’ =x. 13. (A) =A. 

14. (a) x@AyV =x’ Vy. 14’. (a) (AN B)=AUB. 
(b) (x \VyY =x’ Ay’. (b) (AU B) =ANB. 


Thus we may be able to show that a lattice L is not a Boolean algebra by 
showing that it does not possess one or more of these properties. 


Example 7. Show that the lattice whose Hasse diagram is shown in Figure 7.62 
is not a Boolean algebra. 


I 
a f 
e 
0 c 
0 
Figure 7.62 


Solution: Elements a and e are both complements of c; that is, they both 
satisfy properties 11(a) and 11(b) with respect to the element c. But prop- 
erty 11 says that such an element is unique in any Boolean algebra. Thus the 
given lattice cannot be a Boolean algebra. ° 


Example 8. Show that if n is 2 positive integer and p?\n, where p is a prime 
number, then D,, is not a Boolean algebra. 


Solution: Suppose that p‘|n so that n = p’q for some positive integer q. 
Since p is also a divisor cf n, p is an element of D,,. Thus, by the remarks 
given above, if D,, is a Boolean algebra, then p must have a complement p’. 
Then GCD (p, p’) = 1 and LCM (p, p’) = n. By Theorem 6 of Section 1.4, 
pp’ =n,so p’ = nlp = pq. This shows that GCD (p, pq) = 1, which is impos- 
sible, since p and pq have p as a common divisor. Hence D,, cannot be a 
Boolean algebra. a 


If we combine Example 8 and Theorem 2, we see that D,, is a Boolean alge- 
bra if and only if n is the product of distinct primes, that is, if and only if no prime 
divides n more than once. 
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Example 9. Ifn = 40, then n = 23 - 5, so 2 divides n three times. If n = 75, 
then n = 3 - 5*, so 5 divides n twice. Thus neither D, nor D,; are Boolean 
algebras. . 2 


Let us summarize what we have shown about Boolean algebras. We may 
attempt to show that a lattice Z is a Boolean algebra by examining its Hasse dia- 
gram or constructing directly an isomorphism between L and B,, or (P(S), C). We 
may attempt to show that L is not a Boolean algebra by checking the number of 
elements in L or the properties of its partial order. If ZL is a Boolean algebra, then 
we may use any of the properties 1 through 14 to manipulate or simplify expres- 
sions involving elements of L. Simply proceed as if the elements were subsets and 
the manipulations were those that arise in set theory. 

From now on we will denote the Boolean algebra B, simply as B. Thus B 
contains only the two elements 0 and 1. It is sometimes useful to know that any 
of the Boolean algebras B,, can be described in terms of B. The following theo- 
rem gives this description. 


Theorem 4. For any n = 1, B,, is the product Bx Bx---x B of B,n factors, where 
BxBx.--xB is given the product partial order. 


Proof: By definition, B, consists of all n-tuples of 0’s and 1’s, that is, all 
n-tuples of elements from B. Thus, as a set, B, is equalto Bx Bx---xB 
(n factors). Moreover, if x = x,x,---x, and y = y,y,--- y, are two elements 
of B,,, then we know that 


x<=y ifandonlyif x.=y, for all k. 


Thus B,,, identified with B x B x---x B (n factors), has the product partial 
order. ° 


EXERCISE SET 7.4 


In Exercises 1 through 10, determine whether the 3. ¢ e4 » 
poset is a Boolean algebra. Explain. 


1, 


f 


a 
Figure 7.63 


b d d 
2. g 
a f b 
e f 
c 
a 
b c Figure 7.65 Figure 7.66 
a 
Figure 7.64 
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5. n 6. h 
f > g ff 8 
b c 
b d 
a a 
Figure 7.67 Figure 7.68 
1. b 8. d 
| b <> c 
a a 
Figure 7.69 Figure 7.70 
9. Dogs 10. Deo 


11. Are there any Boolean algebras having three 
elements? Why or why not? 


12. Show that in a Boolean algebra, for any a and 
b,a = b if and only if b’ = a’. 


13, Show that in a Boolean algebra, for any a and 
b, a = bif and only if (aA b’) V (a’ Ab) = 0. 


7.5. Functions on Boolean Algebras 


14, Show that in a Boolean algebra, for any a, b, 
and c: 
(a) Ifasb,thenaycsb\c. 
(b) Ifa=b,thenaAcsbc. 


15. Show that in a Boolean algebra the following 
statements are equivalent for any a and b. 
(a) ayvb=b 


(b) aN\b=a 
(c) a’ \Vb=I 
(d) ab’ =0 
(e)asb 


16. Show that in a Boolean algebra, for any a and b, 


(ab) \/ (aN 5) =a. 


17. Show that in a Boolean algebra, for any a and b, 


bA (av (a A (b\/ bY) =. 


. 


18. Show that in a Boolean algebra, for any a, b, 


and c, 


(aN\bAcV(bAc=bAc. 


19. Show that in a Boolean algebra, for any a, b, 
and c, 


(avec) NW Voy =a Vb). 


20. Show that in a Boolean algebra, for any a, b, 
and c, if a = b, then 


a\/(bAc)=bA(aVo). 


Tables listing the values of a finction f for all elements of B,, such as shown 
in Figure 7.71(a), are often called truth tables for f. This is because they are an- 
alogous with tables that arise in logic (see Section 2.1). Suppose that the x, 


represent propositions, and f(x,,%,.. 


.,X,) represents a compound sentence con- 


structed from the x,’s. If we think of the value 0 for a sentence as meaning that 
the sentence is false, and 1 as meaning that the sentence is true, then tables 


such as Figure 7.71(a) show us how the truth or falsity of f(x,, x, .. 


.,X,) depends 


on the truth or falsity of its component sentences x,. Thus such tables are often 
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F (x1, X2, x3) 


Sf (X1, X25. ..5Xn) 


ePereeocooco 
KPOrororHe 


—e— OOCrK COCO 
COrorcHrose 


(a) (b) 
Figure 7.71 


called truth tables, even when they arise in areas other than logic, such as in 
Boolean algebras. 

The reason that such functions are important is that, as shown schemati- 
cally in Figure 7.71(b), they may be used to represent the output requirements 
of a circuit for any possible input values. Thus each x; represents an input circuit 
capable of carrying two indicator voltages (one voltage for 0 and a different 
voltage for 1). The function f represents the desired output response in all cases. 
Such requirements occur at the design stage of all combinational and sequential 
computer circuitry. 

Note carefully that the specification of a function f: B,, + B simply lists cir- 
cuit requirements. It gives no indication of how these requirements can be met. 
One important way of producing functions from B, to B is by using Boolean 
polynomials, which we now consider. 


Boolean Polynomials 


Let x, X),...,X, be a set of m symbols or variables. A Boolean polynomial 
P(x, X>,..-,X,), in the variables x,, is defined recursively as follows: 
1. x,,%,,...,x, are all Boolean polynomials. 


2. The symbols 0 and 1 are Boolean polynomials. 
3. If p(x,,%,...,X,) and q(x), X),...,xX,) are two Boolean polynomials, then 


sO are 
Py Xa) +6 Ky) V U1, Xay Xn) 
and 
P(X, Xp) «+ Xn) A G(X y, X25. Ry) 
4. If p(x, x,...,X,,) is a Boolean polynomial, then so is 


(PQs X25 ++ Xp)’ 
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By tradition, (0)’ is denoted 0’, (1)’ is denoted 1’, and (x,)’ is denoted xj. 
5. There are no Boolear. polynomials in the variables x, other than those 
that can be obtained by repeated use of rules 1, 2,3, and 4. 


Boolean polynomials are also called Boolean expressions. 


Example 1. The following are Boolean polynomials in the variables x, y, and z. 


PAG y. 2) = eV y)Az 

PAXLYOD=HVYIVYAT 

P%Y 2 =EVOADVEAGAD) 

PAX. YZ) = AV YV ZAG Azy AV’ V9). ° 


Ordinary polynomials in several variables such as x’y + 24, xy + yz + x’y?, 
xy’ + xz‘, and so on, are generally interpreted as expressions representing alge- 
braic computations with unspecified numbers. As such, they are subject to the 
usual rules of arithmetic. Thus the polynomials x? + 2x + 1 and (x + 1)(x + 1) 
are considered equivalent, and so are x(xy + yz)(x + z) and xy + 2x’yz + xyz’, 
since in each case we can turn one into the other with algebraic manipulation. 

Similarly, Boolean polynomials may be interpreted as representing 
Boolean computations with unspecified elements of B, that is, with 0’s and 1’s. As 
such, these polynomials are subject to the rules of Boolean arithmetic, that is, to 
the rules obeyed by /, V, and ‘in Boolean algebras. As with ordinary polynomi- 
als, two Boolean polynomials are considered equivalent if we can turn one into 
the other with Boolean manipulations. 

In Section 5.1 we showed how ordinary polynomials could produce func- 
tions by substitution. This process works whether the polynomials involve one or 
several variables. Thus the polynomial xy + yz® produces a function f: R? > R by 
letting f(x, y,z) = xy + yz’. For example, f(3, 4,2) = (3)(4) + (4)(2°) = 44. In a sim- 
ilar way, Boolean polynomials involving n variables produce functions from B, to 
B. These Boolean functions are a natural generalization of those introduced in 
Section 5.2. 


Example 2. Consider the Boolean polynomial 


P(X X25 %3) = (% A x2) V 4, V 3 A x)). 


Construct the truth table for the Boolean function f: B, > B determined by this 
Boolean polynomial. 


Solution: The Boolean function f: B;— B is described by substituting all 
the 2? ordered triples of values from B for x,, x, and x,. The truth table for 
the resulting function is shown in Figure 7.72. Sd 


Boolean polynomials can also be written in a graphical or schematic way. If 
x and y are variables, then the basic polynomials x \/ y,x /\ y, and x’ are shown 
schematically in Figure 7.73. Each symbol has lines for the variables on the left 
and a line on the right representing the polynomial as a whole. The symbol for 
x \/y is called an or gate, that for x /\ y is called an and gate, and the symbol for x’ 
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f (Xp, Xz, X35) = (01 A x2) V Or VV Og A 45) 


rPOoOrOoOrOrFr OO 
Ber H OOH O 


Figure 7.72 


is called an inverter. The logical names arise because the truth tables showing the 
functions represented by x \/ y and x /\ y are exact analogs of the truth table for 
the connectives “or” and “and,” respectively. 


= xVy = xy a x! 
ae 

(a) (b) (c) 
Figure 7.73 


Recall that functions from B, to B can be used to describe the desired 
behavior of circuits with 7 0-or-1 inputs and one 0-or-1 output. In the case of the 
functions corresponding to the Boolean polynomials x \/ y, x /A y, and x’, the 
desired circuits can be implemented, and the schematic forms of Figure 7.73 are 
also used to represent these circuits. By repeatedly substituting these schematic 
forms for \/, A, and’, we can make a schematic form to represent any Boolean 
polynomial. For the reasons given previously, such diagrams are called logic dia- 
grams for the polynomial. 


Example 3. Let p(x, y,z) = (x Ay) V (y 4 z’). Figure 7.74(a) shows the truth 
table for the corresponding function f : B, > B. Figure 7.74(b) shows the logic 
diagram for p. Cy 


Suppose that p is a Boolean polynomial in n variables, and f is the corre- 
sponding function from B, to B. We know that f may be viewed as a description 
of the behavior of a circuit having m inputs and one output. In the same way, the 
logic diagram of p can be viewed as a description of the construction of such a 
circuit, at least in terms of and gates, or gates, and inverters. Thus, if the function 
f, describing the desired behavior of a circuit, can be produced by a Boolean poly- 
nomial p, then the logic diagram for p will give one way to construct a circuit hav- 
ing that behavior. In general, many different polynomials will produce the same 
function. The logic diagrams of these polynomials will represent alternative 
methods for constructing the desired circuit. It is almost impossible to overesti- 
mate the importance of these facts for the study of computer circuitry. 
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fay z=aAyVVAz’) 


BrP OOF K CO 
mrRooOorcTce 


— err OCC oO 


(a) 
a “\ xy 
y 
z (Ay) V (yA2’) 
z Z 
(b) 
Figure 7.74 
EXERCISE SET 7.5 
1. Consider the Boolean polynomial arithmetic to show that the given Boolean poly- 
p(x. y,z) =xA(yV 2’). nomials are equivalent. 
If B = {0,1}, compute the truth table of the 5 (x A(t : 
function f: B, > B defined by p. TENNEY 
2. Consider the Boolean polynomial 6 XxAGVOAYVY)))s x 


PRR YD=AVY)AZV*). 
If B = {0, 1}, compute the truth table of the 
function f : B; > B defined by p. 


RVING AYVIAAR VY); x Ay 


8B (eAZVOVIAIIVIGA2DVE@AZY 
3. Consider the Boolean polynomial xVy 
P(x. yz) = (KA V)V (YA V ¥)). 
If B = {0,1}, compute the truth table of the 
function f: B, > B defined by p. 


9. Construct a logic diagram implementing the 
function f of 
(a) Exercise 1. (b) Exercise 2. 


4. Consider the Boolean polynomial 
Pixsy.z) = («Ay VOX A(yAZ)). 10. Construct a logic diagram implementing the 


function f of 
lf B = {0, 1}, compute the truth table of the 2 : 
ae fi . an , defined by ot (a) Exercise 3. (b) Exercise 4. 


In Exercises 5 through 8, apply the rules of Boolean 
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7.6. Expressing Boolean Functions as 
Boolean Polynomials (Circuit Design) 


In Section 7.5 we considered functions from B,, to B, where B is the Boolean alge- 
bra {0, 1}. We noted that such functions can represent input-output requirements 
for models of many practical computer circuits. We also pointed out that if the 
function is given by some Boolean expression, then we can construct a logic dia- 
gram for it and thus model the implementation of the function. In this section we 
show that all functions from B, to B are given by Boolean expressions, and thus 
logic diagrams can be constructed for any such function. Our discussion illus- 
trates a method for finding a Boolean expression that produces a given function. 

If f: B, > B, we will let S(f) = {b € B, | f(b) = 1}. We then have the fol- 
lowing result. 


Theorem1. Let f, f,, and f, be three functions from B,, to B. 
(a) If S(f) = S(f,) U S(f,), then f(b) = f(b) VV fal) for all b in B. 
(b) If S(f) = S(f,) 0 S(f,), then f(b) = f,(b) “ f(b) for all b in B. 
(Vv and /\ are LUB and GLB, respectively, in B.) 


Proof: (a) Let b € B,.Ifb € S(f), then, by the definition of S(f), f(b) = 1. 
Since S(f) = S(f,) U S(f), either b € S(f,) or b € S(f,), or both. In any case, 
fib) V £0) = 1. Now, if b € S(f), then f(b) = 0. Also, we must have 
b € S(f,) and b € S(f,), so f(b) = 0 and f(b) = 0. This means that 
fb) V f(b) = 0. Thus, for all b € B,, f(b) = fyb) V fy(b). 

(b) This part is proved in a manner completely analogous to that used in 
part (a). Sa 


Recall that a function f: B,, > B can be viewed as a function f(x,,x,...,%,) 
of n variables, each of which may assume the values 0 or 1. If E(x, X,,...,%,) is 
a Boolean expression, then the function that it produces is generated by substi- 
tuting all combinations of 0’s and 1’s for the x,’s in the expression. 


Example |. Let f,: B, — B be produced by the expression E(x, y) = x’, and let 
f,: B, — B be produced by the expression E(x, y) = y’. Then the truth tables of 
f, and f, are shown in Figure 7.75(a) and (b), respectively. Let f: B, > B be the 
function whose truth table is shown in Figure 7.75(c). Clearly, S(f) = S(f,) U S(4), 


fitz y) folx, y) 


oror 


—=r OS 


(a). (b) (c) 
Figure 7.75 


since f; is 1 at the elements (0,0), and (0, 1) of B,, f, is 1 at the elements (0,0) and 
(1.0) of B.. and fis 1 at the elements (0,0), (0, 1), and (1, 0) of B,. By Theorem 1, 
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f =f, Vf; so a Boolean expression that produces f is x’ \/ y’. This is easily veri- 
fied. ° 


It is not hard to show that any function f:B, — B for which S(f) has 
exactly one element is produced by a Boolean expression. Table 7.1 shows the 
correspondence between functions of two variables that are 1 at just one element 
and the Boolean expressions that produce these functions. 


Table 7.1 


S(f) Expression Producing f 


{(0, 0)} vAy 
{(0, 1)} xiy 
{(1,0)} xAy 
{1,1} x/\y 


Example 2. Let f: B, > B be tne function whose truth table is shown in Figure 
7.76(a). This function is equa] to 1 only at the element (0, 1) of B,; that is, 
S(f) = {(0, 1)}. Thus f(x, y) = 1 only when x = 0 and y = 1. This is also true for 
the expression E(x, y) = x’ /\ y, so f is produced by this expression. 


f(x, y, Z) 


eee HOOCOSO 
BPeOOrHoo |< 
rPoOororore 
ooooroco 


(a) 
Figure 7.76 


(b) 


The function f : B, — B whose truth table is shown in Figure 7.76(b) has 
S(f) = {(0, 1, 1)}; that is, f equals 1 only when x = 0, y = 1, and z = 1. This is also 
true for the Boolean expression «’ /\ y A z, which must therefore produce f. @ 


If b € B,, then b is a sequence (c,,c>,...,c¢,,) of length n, where each c, is 0 
or 1, Let E, be the Boolean expression x, /\ x, /\---Ax,, where x, = x, when 
c, = Land x, = x; when c, = 0. Such an expression is called a minterm. Example 
2 illustrates the fact that any furiction f: B,, — B for which S(f) is a single element 
of B,, is produced by a minterm expression. In fact, if S(f) = {b}, it is easily seen 
that the minterm expression E,, produces f. We then have the following result. 
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Theorem 2. Any function f: B,,— B is produced by a Boolean expression. 


Proof: Let S(f) = {b,,5,,...,b,}, and for each i, let f,: B, > B be the func- 
tion defined by 


f(b) = 1 
f(b)=0, ifb#b, 
Then S(f,) = {Bj}, so S(f) = SU) U ++: U SCf,) and by Theorem 1, 


FHARVANV ON Se 

By the discussion given above, each f; is produced by the minterm E£,. 
Thus f is produced by the Boolean expression 

Ey VV Ey VV Ey 
and this completes the proof. 
Example 3. Consider the function f: B, > B whose truth table is shown in Fig- 
ure 7.77. Since S(f) = {(0,1, 1), (1, 1, 1)}, Theorem 2 shows that fis produced by 
the Boolean expression E(x, y,z) = E11) V Euan = @ AyA2V aAYA2). 


This expression, however, is not the simplest Boolean expression that produces f. 
Using properties of Boolean algebras, we have 


O AyA2V@AyAz) = VX) Ay Az) 
=1AQVAz2)=yAz 


Thus fis also produced by the simple expression y /\ z. Sd 


f(% y, 2) 


Beee Oooo 
BeFPOorroo |< 
mp Or ororo 
RPoococoroce 


Figure 7.77 


The process of writing a function as an “or” combination of minterms and 
simplifying the resulting expression can be systematized in various ways. We will 
demonstrate a graphical procedure utilizing what is known as a Karnaugh map. 
This procedure is easy for human beings to use with functions f: B, — B, if n is 
not too large. We will illustrate the method for n = 2,3, and 4. Ifn is large or if'a 
programmable algorithm is desired, other techniques may be preferable. 

We consider first the case where n = 2 so that f is a function of two vari- 
ables, say x and y. In Figure 7.78(a), we Show a 2 X 2 matrix of squares with each 
square containing one possible input b from B,. In Figure 7.78(b), we have 
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Figure 7.78 


replaced each input 6 with the corresponding minterm £,. The labeling of the 
squares in Figure 7.78 is for reference only. In the future we will not exhibit these 
labels, but we will assume that the reader remembers their locations. In Figure 
7.78(b), we note that the x variable appears everywhere in the first row as x’ and 
everywhere in the second row as x. We label these rows accordingly, and we per- 
form a similar labeling of the columns. 


Example 4. Let f: B, — B be the function whose truth table is shown in Figure 
7.79(a). In Figure 7.79(b), we have arranged the values of f in the appropriate 
squares, and we have kept the row and column labels. The resulting 2 x 2 array 
of 0’s and 1’s is called the Karnaugh map of f. Since S(f) = {(0, 0), (0, 1)}, the cor- 
responding expression for fis (x’ Vy) VQ’ Ay) =x Ay’ Vy) =x’. 


x Jy | fi y) 
Eoees Po 

0 0 i 

0 1 1 

1 0 0 * 

1 1 0 

Truth table of f Karnaugh map of f 

(a) (b) 

Figure 7.79 


The outcome of Example 4 is typical. When the 1-values of a function 
f: B, > B exactly fill one row or one column, the label of that row or column 
gives the Boolean expression for f. Of course, we already know that if the 1-val- 
ues of f fill just one square, then f is produced by the corresponding minterm. It 
can be shown that the larger the rectangle of 1-values of f, the smaller the expres- 
sion for f will be. Finally, if the 1-values of f do not lie in a rectangle, we can 
decompose these values into the union of (possibly overlapping) rectangles. 
Then, by Theorem 1, the Boolean expression for f can be found by computing the 
expressions corresponding to each rectangle and combining them with \/. 


Example 5. Consider the function f : B, — B whose truth table is shown in 
Figure 7.80(a). In Figure 7.80(b), we show the Karnaugh map of f and decompose 
the 1-values into the two indicated rectangles. The expression for the function 
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having 1’s in the horizontal rectangle is x’ (verify). The function having all its 1’s 
in the vertical rectangle corresponds to the expression y’ (verify). Thus f corre- 
sponds to the expression x’ \/ y’. In Figure 7.80(c), we show a different decom- 
position of the 1-values of f into rectangles, This decomposition is also correct, 
but it leads to the more complex expression y’ \/ (x’ / y). We see that the decom- 
position into rectangles is not unique and that we should try to use the largest 
possible rectangles. Sd 


(a) (b) (c) 
Figure 7.80 


We now turn to the case of a function f: B; — B, which we consider to 
be a function of x, y, and z. We could proceed as in the case of two variables and 
construct a cube of side 2 to contain the values of f. This would work, but 
three-dimensional figures are awkward to draw and use, and the idea would not 
generalize. Instead, we use a rectangle of size 2 x 4. In Figure 7.81(a) and (b), 
respectively, we show the inputs (from B,) and corresponding minterms for each 
square of such a rectangle. 
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Figure 7.81 
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Shaded region is y’ Shaded region is y 
(a) (b) 


Shaded region is z Shaded region is 2’ 
(c) (d) 


Shaded region gx" Shaded region is x 
(e) ) 
Figure 7.82 


Consider the rectangular a-eas shown in Figure 7.82. If the 1-values for a 
function f: B, > B exactly fill one of the rectangles shown, then the Boolean 
expression for this function is one of the six expressions x, y, z, x’, y’, or 2’, as indi- 
cated in Figure 7.82. 

Consider the situation shown in Figure 7.82(a). Theorem 1(a) shows that f 
can be computed by joining all the minterms corresponding to squares of the 
region with the symbol \/. Thus f is produced by 


MAVAZIVHAVAZDV AAV AZYY Ay Az) 
H(A VNACAZYVI@VAAG’AZ)) 
=AAWAZ))VAAGKA2) 
=VYAZVU'A2Z) 
=¥YACVa=y"Alz=y’ 


A similar computation shows tha: the other five regions are correctly labeled. 

If we think of the left anc right edges of our basic rectangle as glued to- 
gether to make a cylinder, as we show in Figure 7.83, we can say that the six 
large regions shown in Figure 7.82 consist of any two adjacent columns of the cyl- 
inder, or of the top or bottom half-cylinder. 
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Figure 7.83 


The six basic regions shown in Figure 7.82 are the only ones whose corre- 
sponding Boolean expressions need be considered. That is why we used them to 
label Figure 7.81(b), and we keep them as labels for all Karnaugh maps of func- 
tions from B, to B. Theorem 1(b) tells us that, if the 1-values of a function 
f:B,— B form exactly the intersection of two or three of the basic six regions, 
then a Boolean expression for f can be computed by combining the expressions 
for these basic regions with /\ symbols. 

Thus, if the 1-values of the function f are as shown in Figure 7.84(a), then 
we get them by intersecting the regions shown in Figure 7.82(a) and (d). The 
Boolean expression for fis therefore y’ /\ z’. Similar derivations can be given for 
the other three columns. If the 1-values of f are as shown in Figure 7.84(b), we get 
them by intersecting the regions of Figure 7.82(c) and (e), so a Boolean expres- 
sion for fis z /\ x’. In a similar fashion, we can compute the expression for any 
function whose i-values fill two horizontally adjacent squares. There are eight 
such functions if we again consider the rectangle to be formed into a cylinder. 
Thus we include the case where the i-values of f are as shown in Figure 7.84(c). 
The resulting Boolean expression is z’ /\ x’. 

If we intersect three of the basic regions and the intersection is not empty, 
the intersection must be a single square, and the resulting Boolean expression is 
a minterm. In Figure 7.84(d), the 1-values of f form the intersection of the three 
regions shown in Figure 7.82(a), (c), and (f). The corresponding minterm is 
y’ /\z /\x. Thus we need not remember the placement of minterms in Figure 
7.81(b), but instead may reconstruct it. 

We have seen how to compute a Boolean expression for any function 
f: B, > B whose 1-values form a rectangle of adjacent squares (in the cylinder) 
of size 2” X 2”,n = 0,1;m = 0, 1,2. In general, if the set of 1-values of f do not 
form such a rectangle, we may write this set as the union of such rectangles. Then 
a Boolean expression for f is computed by combining the expression associated 
with each rectangle with \/ symbols. This is true by Theorem 1(a). The preceding 
discussion shows that the larger the rectangles that are chosen, the simpler will 
be the resulting Boolean expression. 
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Figure 7.84 


Example 6. Consider the function f whose truth table and corresponding 
Karnaugh map are shown in Figure 7.85. The placement of the 1’s can be derived 
by locating the corresponding inputs in Figure 7.81(a). One decomposition of the 
1-values of f is shown in Figure 7.85(b). From this we see that a Boolean expres- 
sion for fis (y’ Az’) VO Ay '¥ (y Az). ° 
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Figure 7.85 
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Example 7. Figure 7.86 shows the truth table and corresponding Karnaugh map 
for a function f. The decomposition into rectangles shown in Figure 7.86(b) uses 
the idea that the first and last columns are considered adjacent (by wrapping 
around the cylinder). Thus the symbols are left open ended to signify that they 
join in one 2 X 2 rectangle corresponding to z’. The resulting Boolean expression 
is z’ \V (x Ay) (verify). 5 


x y Zz 
0 0 0 1 
0 0 1 0 
0 1 0 1 
0 1 1 0 
1 0 0 1 
1 0 1 0 
1 1 0 1 
1 1 1 1 
(a) (b) 


Figure 7.86 


Finally, without additional comment, we present in Figure 7.87 the distribu- 
tion of inputs and corresponding labeling of rectangles for the case of a function 
f:B,— B, considered as a function of x, y, z, and w. Here again, we consider the 
first and last columns to be adjacent, and the first and last rows to be adjacent, 
both by wrap around, and we look for rectangles with sides of length some power 
of 2, so the length is 1,2, or 4. The expression corresponding to such rectangles is 
given by intersecting the large labeled rectangles of Figure 7.88. 


(a) {b) 
Figure 7.87 
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, 


Shaded region is z Shaded region is z Shaded region is x’ Shaded region is x 


(a) (b) (c) (d) 


Shaded region is y Shaded region is y’ Shaded region is w Shaded region is w’ 


(e) (pH (g) (h) 
Figure 7.88 


Example 8. Figure 7.89 shows the Karnaugh map of a function f: B, > B. The 
1-values are placed by considering the location of inputs in Figure 7.87(a). Thus 
f(0101) = 1, (0001) = 0, and so on. 

The center 2 X 2 square represents the Boolean expression w /\ y (verify). 

The four corners also form a square of side 2, since the right and left edges 
and the top and bottom edges are considered adjacent. From a geometric point 
of view, we can see that if we wrap the rectangle around horizontally, getting a 
cylinder, then when we further wrap around vertically, we will get a torus or inner 
tube. On this inner tube, the four corners form a square of side 2 which represents 
the Boolean expression w’ /\ y’ (verify). 

It then follows that the decomposition above leads to the Boolean expres- 
sion 

(wAy)V (Ww Ay’) 

for f. Sd 
Example 9. In Figure 7.90, we show the Karnaugh map of a function f: B, > B. 
The decomposition of 1-values into rectangles of sides 2”, shown in this figure, 


again uses the wrap-around property of top and bottom rows. The resulting 
expression for f is (verify) 


AY) V& AY Azyva«eAyAzAw). 


The first term comes from the 2 * 2 square formed by joining the 1 x 2 rectan- 
gle in the upper-left corner and the 1 < 2 rectangle in the lower-left corner. The 


Sec. 7.6 Expressing Boolean Functions as Boolean Polynomials (Circuit Design) 281 


second comes from the rectangle of size 1 X 2 in the upper-right corner, and the 
last is a minterm corresponding to the isolated square. 5 


Xx 
x 
Figure 7.89 Figure 7.90 
In Exercises 1 through 6, construct Karnaugh 4. 
maps for the functions whose truth tables are x{y | z[ faye 
given. ololo 0 
1. olo/41 1 
f@y) o;/1|o 1 
0 1 1 1 
0 1 to 0 0 
0 : 1) 0})1 0 
1 0 Ve is ae pa 0 
1 1 riaida 1 
y | fy) gee Bale HRW) 
0 0 0 0 0 
; : : 0 0 0 1 0 
1 0 1 0 0 1 0 1 
1 1 0 0 0 1 1 0 
0 1 0 0 0 
3. 0; 1/0 1 0 
x | ” z f@Y,z) 0 1 1 0 1 
0 1 1 1 0 
1 
; 5 1 1 0 0 0 0 
0 1 0 0 1 0 0 1 0 
0 1 1 0 1 0 1 0 0 
iT 0 0 1 1 0 1 1 1 
1 0 1 0 1 1 0 0 0 
1 1 0 1 1 1 0 1 0 
1 1 1 0 1 1 1 0 1 
1 1 1 1 1 


282 = Chapter7 Order Relations and Structures 


fy, z,) 


PrPrRPRRPrPR COCO OCoOoocoooSD 
PrerPrPOtTCOOrRFRFrRPrRPOCOOCOCO !]*< 


RPrPOOrRrROCORF COCR FRP OO 
mor OoOrROrROrFR OF OF OFS 
OrocrococccorFr cor ocr 


In Exercises 7 through 14 (Figures 7.91 through 
7.98), Karnaugh maps of functions are given, 
and a decomposition of 1-values into rectangles 
is shown. Write the Boolean expression for these 
functions, which arise from the maps and rec- 
tangular decompositions. 


Figure 7.93 


10. 


11. 


12. 


Figure 7.94 


Figure 7.95 


Figure 7.96 
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In Exercises 15 through 20, use the Karnaugh 
map method to find a Boolean expression for 
the function f. 


15. Let f be the function of Exercise 1. 
16. Let f be the function of Exercise 2. 
17. Let f be the function of Exercise 3. 
18. Let f be the function of Exercise 4. 
19. Let f be the function of Exercise 5. 


20. Let f be the function of Exercise 6. 


Figure 7.98 


KEY IDEAS FOR REVIEW 


Partial order on a set: relation that is reflexive, @ Theorem: If A and B are posets, then A X Bis 


antisymmetric, and transitive a poset with the product partial order. 
# Partially ordered set or poset: set together with Dual of a poset (A, =): the poset (A, =), where 
a partial order = denotes the inverse of = 


# Lincarly ordered set: partially ordered set in Hasse diagram: see page 231 
which every pair of elements is comparable ¢ Topological sorting: see page 233 
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# Isomorphism of poscts: see page 234 

# Maximal (minimal) element of a poset: see 
page 239 

@ Theorem: A finite nonempty poset has at least 
one maximal element and at least one minimal 
element. 

# Greatest (least) clement of a poset A: see page 
240 

¢# Theorem: A poset has at most one greatest ele- 
ment and at most one least element. 

# Upper (lower) bound of subset B of poset A: 
element a € A such that b = a (a = BD) for all 
bEB 

Least upper bound (greatest lower bound) of 
subset B of poset A: element a € A such that a 
is an upper (lower) bound of B and a = a’ 
(a’ = a), where a’ is any upper (lower) bound of B 

¢ Lattice: a poset in which every subset consisting 
of two elements has a LUB and a GLB 

@ Theorem: If L, and L, are lattices, then L = 
L, X L, isa lattice. 

¢@ Theorem: Let L be a lattice, and a, b € L. 
Then 
(a)a\/ b = bif and only ifa sb. 

(b) a/ b = aif and only ifa = b. 
(c)a/\ b = aif and only if a\/ b = b. 
¢@ Theorem: Let L be a lattice. Then 
l(a) a\VVa=a 
(b) aAa=a 
2. (a) aVb=b\/a 
(b) a\b=bfa 
3.(a) aV(bVce) = 
(avb)ve 
(b) aA(bAc)= 
(aN b)Ac 
4.(a) av (aN b)=a 
(b) aA (a\/ b)=a 


CODING EXERCISES 


For each of the following, write the requested pro- 


Appendix A) or in a programming language that 


“ete ¢ 


Theorem: Let L be a lattice, and a, b,c € L. 
1. Ifa = b, then 

(a)a\VcsbVc 

(b) a\esbAc 
2.a=candb=cifandonlyifa\yb=c 
3. cSaandc = bifand only ifc sab 
4. Ifa sb andc =d, then 

(a)avicsbvVd 

(b) aAcsb/d 
Isomorphic lattices: see page 250 
Bounded lattice: lattice that has a greatest ele- 
ment 7 and a least element 0 
Theorem: A finite lattice is bounded. 
Distributive lattice: lattice that satisfies the dis- 
tributive laws: 


aN(bVe=(aN bv (ac), 
a\V/ (6c) = (av b) \(aVe) 


Complement of a: element a’ € L (bounded lat- 
tice) such that 


a\/a =I and a/fNad=0 


Theorem: Let L be a bounded distributive lat- 
tice. If a complement exists, it is unique. 
Complemented lattice: bounded lattice in 
which every element has a complement 
Boolean algebra: a lattice isomorphic with 
(P(S), C) for some finite set 5 

Properties of a Boolean algebra: see page 263 
Truth tables: see page 267 

Boolean expression: see page 268 

Minterm: a Boolean expression of the form 
%, AX, /\---AX,, where each X, is either x, or 
xy 

‘Theorem: Any function f: B, > B is produced 
oy a Boolean expression. 

Karnaugh map: see page 274 


you: know. Test your code either with a paper-and- 
gram or subroutine in pseudocode (as described in pencil trace or with a computer run. 
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1. Write a subroutine that determines if a rela- 4. Write a subroutine that, given x, produces the 


tion R represented by its matrix is a partial corresponding minterm. 
order. 
5. Let B = {0,1}. Write a program that prints a 
For Exercises 2 through 4, let truth table for the function f: B, > B defined 
b 
By = (xp noon) 1 & (0) a 


and x,y € B.,. P(E YZ) = KAVIV AGC’ VY). 


2. Write a subroutine that determines if 
xy. 


3. (a) Write a function that computes x / y. 
(b) Write a function that computes x \/ y. 
(c) Write a function that computes x’. 


CHAPTE 


Prerequisite: Chapter 4 


8.1. Trees 


286 


In this chapter we study relations called trees, and we investigate their properties 
and their applications to computer algorithms. 


In this section we study a special type of relation that is exceptionally useful in a 
variety of computer science applications and that is usually represented by its 
digraph. These relations are essential for the construction of data bases and lan- 
guage compilers, to name just two important areas. They are called trees or some- 
times rooted trees, because of the appearance of their digraphs. 

Let A be a set, and let T be a relation on A. We say that T is a tree if there 
is a vertex vy in A with the property that there exists a unique path in T from vp 
to every other vertex in A, but no path from vy to Vp. 

We show below that the vertex vj, described in the definition above, 
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is unique. It is often called the root of the tree 7, and T is then referred to as a 
rooted tree. We write (T, vo) to denote a rooted tree T with root vo. 

If (T, vo) is a rooted tree on the set A, an element v of A will often be 
referred to as a vertex in T. This terminology simplifies the discussion, since it 
often happens that the underlying set A of T is of no importance. 

To help us see the nature of trees, we will prove some simple properties sat- 
isfied by trees. 


Theorem 1. Let (T, vg) be a rooted tree. Then 
(a) There are no cycles in T. 
(b) Vo is the only root of T. 
(c) Each vertex in T, other than vo, has in-degree one, and Vy has in-degree 
zero. 


Proof: (a) Suppose that there is a cycle g in T, beginning and ending at 
vertex v. By the definition of a tree, we know that v # vp, and there must be 
a path p from vy to v. Then q ° p (see Section 4.3) is a path from v9 to v that 
is different from p, and this contradicts the definition of a tree. 

(b) If vj is another root of 7, there is a path p from vy to vj and a path g 
from vj to Vo (Since vj is a root). Then q ° p is a cycle from vy to vo, and this 
is impossible by definition. Hence the vertex vy is the unique root. 

(c) Let w, be a vertex in T other than vo. Then there is a unique path 
Vo: ++ ++ Vg, W, from vy to w, in T. This means that (v,, w,) © T,so w, has in- 
degree at least one. If the in-degree of w, is more than one, there must be 
distinct vertices w, and w, such that (w,, w,) and (w,, w,) are both in T. If 
Ww, # Vv) and w; # vp, there are paths p, from vy to w, and p, from vy to w;, 
by definition. Then (w,, w,) ° p, and (w;, w,) ° p; are two different paths 
from v, to w,, and this contradicts the definition of a tree with root vp. 
Hence, the in-degree of w, is one. We leave it as an exercise to complete the 
proof if w, = vy or w; = vy and to show that vy has in-degree zero. Sd 


Theorem 1 summarizes the geometric properties of a tree. With these prop- 
erties in mind, we can see how the digraph of a typical tree must look. 

Let us first draw the root vg. No edges enter vo, but several may leave, and 
we draw these edges downward. The terminal vertices of the edges beginning at 
Vo Will be called the level 1 vertices, while vy will be said to be at level 0. Also, vo 
is sometimes called the parent of these level 1 vertices, and the level 1 vertices are 
called the offspring of vo. This is shown in Figure 8.1(a). Each vertex at level 1 has 
no other edges entering it, by part (c) of Theorem 1, but each of these vertices 
may have edges leaving the vertex. The edges leaving a vertex of level 1 are 
drawn downward and terminate at various vertices, which are said to be at level 
2. Figure 8.1(b) shows the situation at this point. A parent-offspring relationship 
holds also for these levels (and at every consecutive pair of levels). For example, 
v, would be called the parent of the three offspring v,, vz, and vy. The offspring of 
any one vertex are sometimes called siblings. 

The process above continues for as many levels as are required to complete 
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Wy Level 0 


Level 1 


vg} Level 0 


Figure 8.1 


the digraph. If we view the digraph upside down, we will see why these relations 
are called trees. The largest leve! number of a tree is called the height of the tree. 

We should note that a tree may have infinitely many levels and that any 
level other than level 0 may contain an infinite number of vertices. In fact, any 
vertex could have infinitely many offspring. However, in all our future discus- 
sions, trees will be assumed to have a finite number of vertices. Thus the trees will 
always have a bottom (highest-rumbered) level. The vertices of the tree that 
have no offspring are called the leaves of the tree. 

The vertices of a tree that lie at any one level simply form a set of vertices 
in A. Often, however, it is useful to suppose that the offspring of each vertex of 
the tree are linearly ordered. Thus, if a vertex v has four offspring, we may assume 
that they are ordered, so we may refer to them as the first, second, third, or fourth 
offspring of v. Whenever we draw the digraph of a tree, we automatically assume 
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some ordering at each level by arranging offspring from left to right. Such a tree 
will be called an ordered tree. Generally, ordering of offspring in a tree is not 
explicitly mentioned. If ordering is needed, it is usually introduced at the time 
when the need arises, and it often is specified by the way the digraph of the tree 
is drawn. The following relational properties of trees are easily verified. 


Theorem 2. Let (T, v9) be a rooted tree on a set A. Then 
(a) T is irreflexive. 
(b) T is asymmetric. 
(c) If (a,b) © T and (b,c) € T, then (a,c) € T, for all a,b,and cin A. 


Proof: The proof is left as an exercise. ¢ 


Example 1. Let A be the set of all female descendants of a given human female 
Vo. We now define the following relation T on A: If v, and v, are elements of A, 
then v, T v, if and only if v, is the mother of v,. The relation T on A is a rooted 
tree with root vo. td 


Example 2. Let A = {v1, V2, V3, V4s V51 Ver V7, Vg, Vor Vio} and let T = {(v2, v3), 

(V2, Vi)5 (Vas ¥5)s (Vas V6)s (V5s Va), (Vos Vz) (Var V2) (Vs Vo), (V7, Vio) }- Show that Tis a 

rooted tree and identify the root. 
Solution: Since no paths begin at vertices v,, v3, Vg, Vg, and v9, these ver- 
tices cannot be roots of a tree. There are no paths from vertices v4, v7, v2, and 
Vv, to vertex V,,s0 we must eliminate these vertices as possible roots. Thus, if 
T is a rooted tree, its root must be vertex v,. It is easy to show that there is 
a path from v, to every other vertex. For example, the path v4, v¢, vz, Vy leads 
from v, to Vo, since (V4, V6), (Vg, Vz), and (vz, Vy) are all in 7. We draw the 
digraph of 7, beginning with vertex v,, and with edges shown downward. 
The result is shown in Figure 8.2. A quick inspection of this digraph shows 


Figure 8.2 
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that paths from vertex v, 1c every other vertex are unique, and there are no 
paths from v, to v,. Thus Tis a tree with root v,. « 


If 1 is a positive integer, we say that a tree T is an n-tree if every vertex has 
at most n offspring. If all vertices of 7, other than the leaves, have exactly n off- 
spring, we say that T is a complete n-tree. In particular, a 2-tree is often called a 
binary tree, and a complete 2-tree is often called a complete binary tree. 

Binary trees are extremely important, since there are efficient methods of 
implementing them and searching through them on computers. We will see some 
of these methods in Section 8.3, and we will also see that any tree can be reor- 
ganized as a binary tree. 

Let (T, vo) be a rooted tree on the set A, and let v be a vertex of T. Let B 
be the set consisting of v and all its descendants, that is, all vertices of T that can 
be reached by a path beginning at v. Observe that B C A. Let T(v) be the restric- 
tion of the relation T to B, that is, TM (B X B) (see Section 4.2). In other words, 
T(v) is the tree that results from 7 in the following way. Delete all vertices that 
are not descendants of v and all 2dges that do not begin or end at any such ver- 
tex. Then we have the following result. 


Theorem 3. /f (T, vo) is a rooted tree and v & T, then T(v) is also a rooted tree 
with root v. We will say that T(v) is the subtree of T beginning at v. 


Proof: By definition of 7(v), we see that there is a path from v to every 
other vertex in 7(v). If there is a vertex w in T(v) such that there are two 
distinct paths q and q’ from v to w, and if p is the path in T from vy to v, then 
qe p and q’ o p would be two distinct paths in T from vy to w. This is impos- 
sible, since T is a tree with root vy. Thus each path from v to another vertex 
w in 7(v) must be unique. Also, if g is a cycle at v in T(v), then gq is also a 
cycle in T. This contradicts Theorem 1(a); therefore, g cannot exist. It fol- 
lows that T(v) is a tree with root v. 


Example 3. Consider the tree of Example 2. This tree has root v, and is shown 
in Figure 8.2. In Figure 8.3 we aave drawn the subtrees T(v;), T(v>), and T(v,) 


of T. 
| é | l 


T(Vs) T(v:) 


T(V6) 
Figure 8.3 


EXERCISE SET 8.1 


In Exercises 1 through 8, each relation R is 
defined on the set A. In each case determine if R 
is a tree and, if it is, find the root. 


A = {a, b,c, d, e} 
R = {(a,d), (6, ), (ca), (4 &)} 


2. A = {a,b,c,d, e} 
R = {(a,b), (6, e), (c,d), (4, b), (,@)] 


= {1,2,3,4,5,6} 
= {(2, 1), (3, 4), (5, 2), (6,5), (6, 3)} 


1,2,3, 4,5, 6} 
(1,1), (2, 0), (2,3), 3, 4), (4, 5), (4, 6)} 


w 
fi [ 


3, 4, 5, 6} 
»2), 3) (4,5), (4, 6)} 
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1, U,V, W,X, y, Z} 


tt, 
{(t, 4), (4, ), (4, x), (iv) (YZ), (YY) 


8. A = u,v, w,x, y, z} 
R = {(u, x), (u,v), (w, v), (x, 2), (%, »)) 


In Exercises 9 through 13, consider the rooted 
tree (T, vo) shown in Figure 8.4. 


9. (a) List all level-3 vertices. 
(b) List all leaves. 


10. (a) What are the siblings of v,? 
(b) What are the descendants of v,? 


11. (a) Compute the tree T(v,). 
(b) Compute the tree T(v3). 


12, (a) What is the height of (T, v,)? 
(b) What is the height of T(v;)? 


Figure 8.4 


(T, Vo) 
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13. Is (T, vy) an n-tree? If so, for what integer n? 
Is (T, v9) a complete n-tree? If so, for what 
integer n? 

14. Prove Theorem 2. 


15. Let T be a tree. Suppose that 7 has r vertices 
and s edges. Find a formula relating r to s. 


16. Draw all possible unordered trees on the set 
S = {a,b,c}. 


17. (a) What is the maximum height for a tree on 
S = {a, b,c, d, e}? Explain. 


8.2. Labeled Trees 


(b) What is the maximum height for a com- 
plete binary tree on S = {a, b, c, d, e}? 


18. Show that if (T, vy) is a rooted tree, then v, has 
in-degree zero. 


19, Show that the maximum number of vertices in 
a binary tree of height n is 2"*' — 1. 


20. If T is a complete n-tree with exactly three 
levels, prove that the number of vertices of T 
must be 1 + kn, where2 Sk Sn +1. 


It is sometimes useful to label the vertices or edges of a digraph to indicate that 
the digraph is being used for a particular purpose. This is especially true for many 
uses of trees in computer science. We will now give a series of examples in which 
the sets of vertices of the trees are not important, but rather the utility of the tree 
is best emphasized by the labels on these vertices. Thus we will represent the ver- 
tices simply as dots and show the label of each vertex next to the dot represent- 


ing that vertex. 


Example 1. Consider the fully parenthesized, algebraic expression 
3 - (2X x)) + (&@ -— 2) - (3 + x)). 


We assume, in such an expression, that no operation such as —, +, X,or + 
can be performed until both of its arguments have been evaluated, that is, until 
all computations inside both the left and right arguments have been performed. 
Therefore, we cannot perform the central addition until we have evaluated 
(3 - (2 X x)) and ((x — 2) — (3 + x)). We cannot perform the central subtraction 
in ((x — 2) — (3 + x)) until we evaluate (x — 2) and (3 + x), and so on. It is easy 
to see that each such expression has a central operator, corresponding to the last 
computation that can be perforined. Thus + is central to the main expression 
above, — is central to (3 — (2 X x)), and so on. An important graphical represen- 
tation of such an expression is as a labeled binary tree. In this tree the root is 
labeled with the central operator of the main expression. The two offspring of the 
root are labeled with the central operator of the expressions for the left and right 
arguments, respectively. If either argument is a constant or variable, instead of an 
expression, this constant or variadle is used to label the corresponding offspring 
vertex. This process continues until the expression is exhausted. Figure 8.5 shows 
the tree for the original expression of this example. To illustrate the technique 
further, we have shown in Figure 8.6 the tree corresponding to the full parenthe- 


sized expression 


(3 x (1. ~ x)) + (4 + (7 — (y + 2))) x (7 + @& = y)). 


4 
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Figure 8.5 


Figure 8.6 
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Our final example of a labeled tree is important for the computer imple- 
mentation of a tree data structure. We start with an 7-tree (T, vp). Each vertex in 
T has at most 7 offspring. We irnagine that each vertex potentially has exactly n 
offspring, which would be ordered from 1 to v, but that some of the offspring in 
the sequence may be missing. The remaining offspring are labeled with the posi- 
tion that they occupy in the hypothetical sequence. Thus the offspring of any ver- 
tex are labeled with distinct numbers from the set {1, 2,...,n}. 

Such a labeled digraph is sometimes called positional, and we will also use 
this term. Note that positional trees are also ordered trees. When drawing the 
digraphs of a positional tree, we will imagine that the n offspring positions for 
each vertex are arranged symmetrically below the vertex, and we place in its 
appropriate position each offspring that actually occurs. 

Figure 8.7 shows the digraph of a positional 3-tree, with all actually occur- 
ring positions labeled. If offspring 1 of any vertex v actually exists, the edge from 
v to that offspring is drawn sloping to the left. Offspring 2 of any vertex v is drawn 
vertically downward from v, whenever it occurs. Similarly, offspring labeled 3 will 
be drawn to the right. Naturally, the root is not labeled, since it is not an offspring. 

The positional binary tree is of special importance. In this case, for obvious 
reasons, the positions for poteatial offspring are often labeled /eft and right, 
instead of 1 and 2. Figure 8.8 shows the digraph of a positional binary tree, with 
offspring labeled L for left and R for right. Labeled trees may have several sets 
of labels, all in force simultaneously. We will usually omit the left-right labels on 
a positional binary tree in order to emphasize other useful labels. The positions 


Figure 8.7 
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Figure 8.8 


of the offspring will then be indicated by the direction of the edges, as we have 
drawn them in Figure 8.8. 


Computer Representation of Binary 
Positional Trees 


In Section 4.6, we discussed an idealized information storage unit called a cell. A 
cell contains two items. One is data of some sort and the other is a pointer to the 
next cell, that is, an address where the next cell is located. A collection of such 
cells, linked together by their pointers, is called a linked list. The discussion in 
Section 4.6 included both a graphical representation of linked lists, and an imple- 
mentation of them that used arrays. 

We will need an extended version of this concept, called a doubly linked list, 
in which each cell contains two pointers and a data item. We use the pictorial 
symbol <£@[ | @}~ to represent these new cells. The center space represents 
data storage and the two pointers, called the left pointer and the right pointer, are 
represented as before by dots and arrows. Once again we use the symbol ® + 
for a pointer signifying no additional data. Sometimes a doubly linked list is 
arranged so that each cell points to both the next cell and the previous cell. This 
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is useful if we want to search through a set of data items in either direction. Our 
use of doubly linked lists here is very different. We will use them to represent 
binary positional labeled trees. Each cell will correspond to a vertex, and the data 
part can contain a label for the vertex or a pointer to such a label. The left and 
right pointers will direct us to the left and right offspring vertices, if they exist. If 
either offspring fails to exist. the corresponding pointer will be =. 

We implement this representation by using three arrays: LEFT holds point- 
ers to the left offspring, RIGHT holds the pointers to the right offspring, and 
DATA holds information or labels related to each vertex, or pointers to such 
information. The value 0, used as a pointer, will signify that the corresponding off- 
spring does not exist.To the linked list and the arrays we add a starting entry that 
points to the root of the tree. 


Example2. We consider again the positional binary tree shown in Figure 8.5. In 
Figure 8.9(a), we represent this tree as a doubly linked list, in symbolic form. In 
Figure 8.9(b), we show the implementation of this list as a sequence of three 
arrays (see also Section 4.6). The first row of these arrays is just a starting point 
whose left pointer points to the root of the tree. As an example of how to inter- 
pret the three arrays, consider the fifth entry in the array DATA, which is x. The 
fifth entry in LEFT is 6, which means that the left offspring of X is the sixth entry 
in DATA, or 2. Similarly, the fifth entry in RIGHT is 7, so the right offspring of 
x is the seventh entry in DATA. or x. a 


Example 3. Now consider the t-ee of Figure 8.6. We represent this tree in Figure 
8.10(a) as a doubly linked list. As before, Figure 8.10(b) shows the implementa- 
tion of this linked list in three arrays. Again, the first entry is a starting point 
whose left pointer points to the root of the tree. We have listed the vertices in a 
somewhat unnatural order to show that, if the pointers are correctly determined, 
any ordering of vertices can be used. Sd 


Figure 8.9 (a) 
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(b) 


Figure 8.9 (cont.) 


(a) 


Figure 8.10 
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Figure 8.10 (cont.) 


EXERCISE SET 8.2 


In Exercises 1 through 10, construct the tree of 


the algebraic expression. 


1, 


2. 


3. 


4 


5. 


6. 


(7 + (6—2))—-@-(y- 4) 
(e+ y—@ + y))) X(B +O XT) X 4) 


3- («+ (6X (44 (2-3) 


((2X7)+x)+y)+@G-11) 
(2 +x) — (2X x)) - @- 2) 


(11 — (11 x (11 +: 11))) + (11 + (11 Xx 11)) 


10. 


11. 


. (3-(2-(1 


. (x+y) 4 


RIGHT 


(9-4) = 2+Gr 
(4+7))) 


((@ x 3) — (z+ 4) 


. (2X x) + B- (4X x))) + (eX - 3 X11) 


(1 +1)+ 0 —-2))+(2-x)+1 


Construct the digraphs of all distinct binary 
positional trees having three or fewer edges 
and height 2. 
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12. How many distinct binary positional trees are 
there with height 2? 


13. How many distinct positional 3-trees are there 
with height 2? 


14. Construct the digraphs of all distinct positional 
3-trees having two or fewer edges. 


15. Below is the doubly linked list representation 
of a binary positional labeled tree. Construct 
the digraph of this tree with each vertex labeled 
as indicated. 


INDEX LEFT DATA RIGHT 


Figure 8.11 


1 
s In Exercises 17 through 20, give arrays LEFT, 
4 DATA, and RIGHT describing the tree created 
5 in the indicated exercise. 
3 17. Exercise 1 
8 : 
9 18. Exercise 4 
16. Give arrays LEFT, DATA, and RIGHT 19. Exercise 5 
describing the tree given in Figure 8.11 as a 
doubly linked list. 20. Exercise 8 


8.3. Tree Searching 


There are many occasions when it is useful to consider each vertex of a tree T 
exactly once in some specified order. As each successive vertex is encountered, 
we may wish to take some action or perform some computation appropriate to 
the application being represented by the tree. For example, if the tree T is 
labeled, the label on each vertex may be displayed. If T is the tree of an algebraic 
expression, then at each vertex we may want to perform the computation indi- 
cated by the operator that labels that vertex. Performing appropriate tasks at a 
vertex will be called visiting the vertex. This is a convenient, nonspecific term that 
allows us to write algorithms without giving the details of what constitutes a 
“visit” in each particular case. 

The process of visiting each vertex of a tree in some specified order will be 
called searching the tree or performing a tree search. In some texts, this process 
is called walking or traversing the tree. 

Let us consider tree searches on binary positional trees. Recall that in a 
binary positional tree each vertex has two potential offspring. We denote these 
potential offspring by v, (the left offspring) and vp, (the right offspring), and 
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either or both may be missing. If a binary tree T is not positional, it may always 
be labeled so that it becomes positional. 

Let T be a binary positional tree with root v. Then, if v, exists, the subtree 
T(v,) (see Section 8.1) will be called the left subtree of T, and if vz exists, the sub- 
tree T(vp) will be called the right subtree of T. 

Note that T(v,), if it exists, is a positional binary tree with root v,, and sim- 
ilarly T(vp) is a positional binary tree with root vp. This notation allows us to 
specify searching algorithms in a natural and powerful recursive form. Recall that 
recursive algorithms are those that refer to themselves. We first describe a 
method of searching called a preorder search. For the moment, we leave the 
details of visiting a vertex of a tree unspecified. Consider the following algorithm 
for searching a positional binary tree T with root v. 


ALGORITHM PREORDER 

STEP 1. Visit v. 

Step 2. If v, exists, then apply this algorithm to (T(v,), v,). 
STEP 3. If vp exists, then apply this algorithm to (T(v,), Vz). 
End of Algorithm 


Informally, we see that a preorder search of a tree consists of the following 
three steps: 


1. Visit the root. 
2. Search the left subtree if it exists. 
3. Search the right subtree if it exists. 


Example 1. Let Tbe the labeled, positional binary tree whose digraph is shown 
in Figure 8.12(a). The root of this tree is the vertex labeled A. Suppose that, for 
any vertex v of T, visiting v prints out the label of v. Let us now apply the pre- 
order search algorithm to this tree. Note first that if a tree consists only of one 
vertex, its root, then a search of this tree simply prints out the label of the root. 
In Figure 8.12(b), we have placed boxes around the subtrees of T and numbered 
these subtrees (in the corner of the boxes) for convenient reference. 

According to PREORDER, applied to 7, we will visit the root and print A, 
then search subtree 1, and then subtree 7. Applying PREORDER to subtree 1 
results in visiting the root of subtree 1 and printing B, then searching subtree 2, 
and finally searching subtree 4. The search of subtree 2 first prints the symbol C 
and then searches subtree 3. Subtree 3 has just one vertex, and so, as previously 
mentioned, a search of this tree yields just the symbol D. Up to this point, the 
search has yielded the string ABCD. Note that we have had to interrupt the 
search of each tree (except subtree 3, which is a leaf of T) in order to apply the 
search procedure to a subtree. [hus we cannot finish the search of T by search- 
ing subtree 7 until we apply the search procedure to subtrees 2 and 4. We could 
not complete the search of subtree 2 until we search subtree 3, and so on. The 
bookkeeping brought about by these interruptions produces the labels in the 
desired order, and recursion is a simple way to specify this bookkeeping. 

Returning to the search, we have completed searching subtree 2, and we 
now must search subtree 4, since this is the right subtree of tree 1. Thus we print 
E and search subtrees 5 and 6 in order. These searches produce F and G. The 


Figure 8.12 
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(b) 


search of subtree 1 is now complete, and we go to subtree 7. Applying the same 
procedure, we can see that the search of subtree 7 will ultimately produce the 
string HIJKL. The result, then, of the complete search of T is to print the string 
ABCDEFGHUIKL. Sa 


Example 2. Consider the completely parenthesized expression (a — b) X (c + 
(d + e)). Figure 8.13(a) shows the digraph of the labeled, positional binary tree 
representation of this expression. We apply the search procedure PREORDER 
to this tree, as we did to the tree in Example 1. Figure 8.13(b) shows the various 
subtrees encountered in the search. Proceeding as in Example 1 and sup- 
posing again that visiting v simply prints out the label of v, we see that the string 
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(b) 


Figure 8.13 


x —ab+c-+ de is the result of the search. This is the prefix or Polish form 
of the given algebraic expression. Once again, the numbering of the boxes in 
Figure 8.13(b) shows the order in which the algorithm PREORDER is applied to 
subtrees. Sa 


The Polish form of an algebraic expression is interesting because it repre- 
sents the expression unambiguously, without the need for parentheses. To evalu- 
ate an expression in Polish forrn, proceed as follows. Move from left to right until 
we find a string of the form Fx}, where F is the symbol for a binary operation (say 
+,-—, X, and so on) and x and y are numbers. Evaluate xFy and substitute the 
answer for the string Fxy. Continue this procedure until only one number 
remains. 

For example, in the expression above, suppose that a = 6,b = 4,c =5,d= 2, 
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and e = 2. Then we are to evaluate x — 64 + 5 + 2 2. This is done in the follow- 
ing sequence of steps. 

1. xX -64+4+5+22. 

2. X*2+5+22~ since the first string of the correct type is —6 4 and 


6-4=2. 
3. X2+51 replacing + 22 by 2 + 2or1. 
4. X26 replacing + 51 by 5+ 1lor6. 
5. 12 replacing X 2 6 by 2 X 6. 


This example is one of the primary reasons for calling this type of search the pre- 
order search, because here the operation symbol precedes the arguments. 

Consider now the following informal descriptions of two other procedures 
for searching a positional binary tree T with root v. 


ALGORITHM INORDER 

Step 1. Search the left subtree (7(v,), v_), if it exists. 
STEP 2. Visit the root, v. 

Step 3. Search the right subtree (T(v,), Vp), if it exists. 
End of Algorithm 


ALGORITHM POSTORDER 

STEP 1. Search the left subtree (T(v,), v,), if it exists. 
Step 2. Search the right subtree (T(v,), Va), if it exists. 
STEP 3. Visit the root, v. 

End of Algorithm 


As indicated by the naming of the algorithms, these searches are called 
respectively the inorder and postorder searches. The names indicate when the 
root of the (sub)tree is visited relative to when the left and right subtrees are 
searched. Informally, in a preorder search, the order is root, left, right; for an 
inorder search, it is left, root, right; and for a postorder search, it is left, right, root. 


Example 3. Consider the tree of Figure 8.12(b) and apply the algorithm 
INORDER to search it. First we must search subtree 1. This requires us to first 
search subtree 2, and this in turn requires us to search subtree 3. As before, a 
search of a tree with only one vertex simply prints the label of the vertex. Thus D 
is the first symbol printed. The search of subtree 2 continues by printing C and 
then stops, since there is no right subtree at C. We then visit the root of subtree 1 
and print B, and proceed to the search of subtree 4, which yields F, E, and G, in 
that order. We then visit the root of T and print A and proceed to search subtree 
7. The reader may complete the analysis of the search of subtree 7 to show that 
the subtree yields the string J/HKL. Thus the complete search yields the string 
DCBFEGANHKL. 

Suppose now that we apply algorithm POSTORDER to search the same 
tree. Again, the search of a tree with just one vertex will yield the label of that 
vertex. In general, we must search both the left and the right subtrees of a tree 
with root v before we print out the label at v. 

Referring again to Figure 8.12(b), we see that both subtree 1 and subtree 7 
must be searched before A is printed. Subtrees 2 and 4 must be searched before 
Rie nrinted and so on. 


304 


Chapter 8 


Trees 


The search of subtree 2 requires us to search subtree 3, and D is the first 
symbol printed. The search of subtree 2 continues by printing C. We now search 
subtree 4 yielding F, G, and E. We next visit the root of subtree 1 and print B. 
Then we proceed with the search of subtree 7 and print the symbols J, J, L, 
K, and H. Finally, we visit the root of T and print A. Thus we print out the string 
DCFGEBJILKHA. Sd 


Example 4. Let us now apply the inorder and postorder searches to the alge- 
braic expression tree of Example 2 [see Figure 8.13(a)]. The use of INORDER 
produces the string a - b X c + d + e. Notice that this is exactly the expression 
that we began with in Example 2, with all parentheses removed. Since the alge- 
braic symbols lie between their arguments, this is often called the infix notation, 
and this explains the name INORDER. The expression above is ambiguous with- 
out parentheses. It could have come from the expression a — (b X ((c + d) + e)), 
which would have produced a different tree. Thus the tree cannot be recovered 
from the output of search procedure INORDER, while it can be shown that the 
tree is recoverable from the Polish form produced by PREORDER. For this rea- 
son, Polish notation is often better for computer applications, although infix form 
is more familiar to human beings. 

The use of search procedue: POSTORDER on this tree produces the string 
ab — cde + + X.This is the postfix or reverse Polish form of the expression. It is 
evaluated in a manner similar to that used for Polish form, except that the oper- 
ator symbol is after its arguments rather than before them. Ifa = 2,b = 1,c =3,d = 
4,and e = 2, the expression above is evaluated in the following sequence of steps. 


1.21-342++4+-*x. 

2.1342++*xX replacing 2 1 — by2 — lorl. 

3.132+ x replacing 42 + by 4 +2 or2. 

4,15*x replacing 32 + by3 + 2or5. 

5. 5 replacing 15 X by 1 X Sor 5. 


Reverse Polish form is also parenthesis free, and from it we can recover the 
tree of the expression. It is used even more frequently than the Polish form. 


Searching General Trees 


Until now, we have only shown how to search binary positional trees. We now 
show that any ordered tree T (sez Section 8.1) may be represented as a binary 
positional tree that, although different from T, captures all the structure of T and 
can be used to re-create T. With the binary positional description of the tree, we 
may apply the computer representation and search methods previously devel- 
oped. Since any tree may be orclered, we can use this technique on any (finite) 
tree, 

Let T be any ordered tree and let A be the set of vertices of T. Define a 
binary positional tree B(T) on the set of vertices A, as follows. If v € A, then the 
left offspring v, of v in B(T) is the first offspring of v in T, if it exists. The right 
offspring v, of v in B(T) is the next sibling of v in T (in the given order of sib- 
lings in T), if it exists. 
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Example 5. Figure 8.14(a) shows the digraph of a labeled tree T. We assume 
that each set of siblings is ordered from left to right, as they are drawn. Thus the 
offspring of vertex 1, that is, vertices 2, 3, and 4, are ordered with vertex 2 first, 
3 second, and 4 third. Similarly, the first offspring of vertex 5 is vertex 11, the sec- 
ond is vertex 12, and the third is vertex 13. 

In Figure 8.14(b), we show the digraph of the corresponding binary posi- 
tional tree, B(T). To obtain Figure 8.14(b), we simply draw a left edge from each 


Figure 8.14 
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vertex v to its first offspring (if v has offspring). Then we draw a right edge from 
each vertex v to its next sibling (in the order given), if v has a next sibling. Thus 
the left edge from vertex 2, in Figure 8.14(b), goes to vertex 5, because vertex 5 
is the first offspring of vertex 2 in the tree T. Also, the right edge from vertex 2, 
in Figure 8.14(b), goes to vertex 3, since vertex 3 is the next sibling in line (among 
all offspring of vertex 1). A doubly-linked-list representation of B(T) is some- 
times simply referred to as a linked-list representation of T. Sa 


Example 6. Figure 8.15(a) shows the digraph of another labeled tree, with sib- 
lings ordered from left to right, as indicated. Figure 8.15(b) shows the digraph of 
the corresponding tree B(T), and Figure 8.15(c) gives an array representation of 
B(T). As mentioned above, the data in Figure 8.15(c) would be called a linked- 
list representation of T. es 


Pseudocode Versions 


The three search algorithms in this section have straightforward pseudocode ver- 
sions, which we present here. In each, we assume that the subroutine VISIT has 
been previously defined. 
SUBROUTINE PREORDER(T, v) 
1. CALL VISIT(v) 
2. IF (v, exists) THEN 
a. CALL PREORDER(T(v,), vz) 
3. IF (vp exists) THEN 
a. CALL PREORDER(T(v,), Vx) 
4. RETURN 
END OF SUBROUTINE PREORDER 


SUBROUTINE INORDER(T, v) 
1. IF (v, exists) THEN 
a. CALL INORDER(T7(7,), v;) 
2. CALL VISIT(v) 
3. IF (vp exists) THEN 
a. CALL INORDER(T(v), Vp) 
4, RETURN 
END OF SUBROUTINE [INORDER 


SUBROUTINE POSTORDER(T, v) 
LIF (v, exists) THEN 


a. CALL POSTORDERI(T(v,), v,) 
2. IF (vg exists) THEN 
a. CALL POSTORDERI(T(v), vg) 
3. CALL VISIT(v) 
4. RETURN 
END OF SUBROUTINE. POSTORDER 
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EXERCISE SET 8.3 


In Exercises 1 through 4 (Figures 8.16 through 
8.19), the digraphs of labeled, positional binary 
trees are shown. In each case we suppose that 
visiting a node results in printing out the label of 
that node. For each exercise, show the result of 
performing a preorder search of the tree whose 
digraph is shown. 


L x 


y z g 
Figure 8.18 


Figure 8.16 


in 


Figure 8.19 


In Exercises § through 12, visiting a node means 
printing out the label of the node. 


5. Show the result of performing an inorder 
search of the tree shown in Figure 8.16. 


6. Show the result of performing an inorder 
search of the tree shown in Figure 8.17. 


T. 


Py 


Show the result of performing an inorder 
search of the tree shown in Figure 8.18. 


8. Show the result of performing an inorder 
Figure 8.17 search of the tree shown in Figure 8.19. 


9. 


10. 


12. 


13. 


. 


Show the result of performing a postorder 
search of the tree shown in Figure 8.16. 


Show the result of performing a postorder 
search of the tree shown in Figure 8.17. 


Show the result of performing a postorder 
search of the tree shown in Figure 8.18. 


Show the result of performing a postorder 
search of the tree shown in Figure 8.19. 


Consider the tree digraph shown in Figure 8.20 
and the following list of words. Suppose that 
visiting a node of this tree means printing out 
the word corresponding to the number that 
labels that node. Print out the sentence that 
results from doing a postorder search of the 
tree. 


. ONE 


. PURPLE 11. SAW 


1 
2 
3. 
4. NEVER 10. 
5 
6. NEVER 12. HOPE 


11 


Figure 8.20 
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In Exercises 14 and 15, evaluate the expression, 
which is given in Polish, or prefix, notation. 


14. x —-+34-72+12x3-64 


15. + —X3xx4y+15 X 2 — 6y, where x is 2 
and y is 3. 


In Exercises 16 and 17, evaluate the expression, 
which is given in reverse Polish, or postfix, nota- 
tion. 


16.432+-5xX42x5x34+4+ 


17,.x2-3+23y+—w3- X +,where xis 7,y 
is 2, and w is 1. 

18. Consider the labeled tree whose digraph is 

shown in Figure 8.21. Draw the digraph of the 

corresponding binary positional tree A(T). 

Label the vertices of B(7) to show their corre- 

spondence to vertices of 7. 


? 


e 
w x y z 
Figure 8.21 
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19. We give below, in array form, the doubly- 
linked-list representation of a labeled tree T 
(not binary). Draw the digraph of both the 
labeled binary tree B(T) actually stored in the 
arrays and the labeled tree T of which B(T) is 
the binary representation. 


INDEX) LEFT | DATA |RIGHT 


1 2 0 
2 3 a 0 
3 4 b 5 
4 6 c i] 
5 8 d 0 
6 0 e 10 
7 0 f 0 
8 0 g 11 
9 0 h 0 
10 0 i i: 
11 0 j 12 
12 0 k 0 
20. Consider the digraph of the labeled binary Figure 8.22 


positional tree shown in Figure 8.22. If this tree 
is the binary form B(T) of some tree T, draw 
the digraph of the labeled tree T. 


8.4. Undirected Trees 


An undirected tree is simply the symmetric closure of a tree (see Section 4.7); 
that is, it is a tree with all edges raade bidirectional. As is the custom with sym- 
metric relations, we represent an undirected tree by its graph, rather than by its 
digraph. The graph of an undirected tree T will have a single line without arrows 
connecting vertices a and b whenever (a, b) and (b, a) belong to T. The set {a, 5}, 
where (a, b) and (b,a) are in T, is called an undirected edge of T (see Section 4.4). 
In this case, the vertices a and b are called adjacent vertices. Thus each undirected 
edge {a, b} corresponds to two ordinary edges, (a, b) and (5, a). The lines in the 
graph of an undirected tree T correspond to the undirected edges in T. 


Example 1. Figure 8.23(a) shows the graph of an undirected tree T. In Figure 
8.23(b) and (c), we show digraphs of ordinary trees T, and T,, respectively, which 
have T as symmetric closure. Th:s merely shows that an undirected tree will, in 
general, correspond to many directed trees. Labels are included to show the cor- 
respondence of underlying vertices in the three relations. Note that the graph of 
T in Figure 8.23(a) has six lines (undirected edges), although the relation T con- 
tains 12 pairs. Sa 
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(c) 


Figure 8.23 


We want to present some useful alternative definitions of an undirected 
tree, and to do so we must make a few remarks about symmetric relations. 

Let R be a symmetric relation, and let p:v,,v,...,v, be a path in R. We will 
say that p is simple if no two edges of p correspond to the same undirected edge. 
If, in addition, v, equals v,, (so that p is a cycle), we will call p a simple cycle. 


Example 2. Figure 8.24 shows the graph of a symmetric relation R. The path 
a, b, c, e, d is simple, but the path f, e, d, c, d, a is not simple, since d, c and c, d 
correspond to the same undirected edge. Also, f, e, a, d, b, a, f and d, a, b, d are 
simple cycles, but f, e, d, c, e, f is not a simple cycle, since f, e and e, f correspond 
to the same undirected edge. ¢ 


Figure 8.24 
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We will say that a symmetric relation R is acyclic if it contains no simple 


cycles. It can be shown that if R contains any cycles, then it contains a simple 
cycle. Recall (see Section 4.4) that a symmetric relation R is connected if there is 
a path in R from any vertex to any other vertex. 


The following theorem provides a useful equivalent statement to the previ- 


ous definition of an undirected tree. 


Theorem 1. Let R be a symmetric relation on a set A. Then the following state- 
ments are equivalent. 


(a) R is an undirected tree. 
(b) R is connected and acyclic. 


Proof: We will prove that part (a) implies part (b), and we will omit the 
proof that part (b) implies part (a). We suppose that R is an undirected tree, 
which means that R is the symmetric closure of some tree T on A. Note first 
that if (a,b) € R, we must have either (a, b) € T or (6, a) € T. In geomet- 
ric terms, this means that every undirected edge in the graph of R appears 
in the digraph of T, directed one way or the other. 

We will show by contradiction that R has no simple cycles. Suppose that 
R has a simple cycle p: v,, ¥2,...,¥,, ¥,. For each edge (v,, v,) in p, choose 
whichever pair (v, v,) or (v; v,) is in T. The result is a closed figure with 
edges in T, where each edg2 may be pointing in either direction. Now there 
are three possibilities. Either all arrows point clockwise, as in Figure 8.25(a), 
all point counterclockwise, or some pair must be as in Figure 8.25(b). Figure 
8.25(b) is impossible, since in a tree T every vertex has in-degree 1 (see 
Theorem 1 of Section 8.1). But either of the other two cases would mean 
that T contains a cycle, which is also impossible. Thus the existence of the 
cycle p in R leads to a contradiction and so is impossible. 

We must also show that R is connected. Let vy be the root of the tree T. 
Then, if a and b are any vertices in A, there must be paths p from v, to a and 
q from v, to b, as shown in. Figure 8.25(c). Now all paths in T are revers- 
ible in R, so the path g © p~', shown in Figure 8.25(d), connects a with b 
in R, where p~' is the reverse path of p. Since a and b are arbitrary, R is con- 
nected, and part (b) is proved. A 


There are other useful characterizations of undirected trees, We state two 


of these without proof in the following theorem. 


Theorem 2. Let R be a symmetric relation on a set A. Then R is an undirected 
tree if and only if either of the following statements is true. 


(a) R is acyclic, and if any undirected edge is added to R, the new relation will 
not be acyclic. 

(b) R is connected, and if any undirected edge is removed from R, the new 
relation will not be connected. Sd 


The following theorem will ise useful in finding certain types of trees. 
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(ce) (d) 


Figure 8.25 


Theorem 3. A tree with n vertices has n — 1 edges. 


Proof: Because a tree is connected, there must be at least n — 1 edges to 
connect the n vertices. Suppose that there are more than n — 1 edges. Then 
either the root has in-degree 1 or some other vertex has in-degree at least 
2. But by Theorem 1, Section 8.1, this is impossible. Thus there are exactly 
n — 1 edges. ¢ 
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Spanning Trees of Connected Relations 


If R is a symmetric, connected relation on a set A, we say that a tree Ton A isa 
spanning tree for R if T is a tree with exactly the same vertices as R and which 
can be obtained from R by deleting some edges of R. 


Example 3. The symmetric relation R whose graph is shown in Figure 8.26(a) 
has the tree T’, whose digraph is shown in Figure 8.26(b), as a spanning tree. Also, 
the tree T”, whose digraph is shown in Figure 8.26(c), is a spanning tree for R. Since 


a a 
b c b c 
d é d € 

f f 


qT’ 
(a) (b) 
a 
b c b c 
d e d € 
f 
T" 
(c) (d) 


Figure 8.26 
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R, T’, and T” are all relations on the same set A, we have labeled the vertices to 
show the correspondence of elements. As this example illustrates, spanning trees 
are not unique. 


Sometimes there is interest in an undirected spanning tree for a symmetric, 
connected relation R. This is just the symmetric closure of a spanning tree. Figure 
8.26(d) shows an undirected spanning tree for R that is derived from the span- 
ning tree of Figure 8.26(c). If R is a complicated relation that is symmetric and 
connected, it might be difficult to devise a scheme for searching R, that is, for vis- 
iting each of its vertices once in some systematic manner. If R is reduced to a 
spanning tree, the searching algorithms discussed in Section 8.3 can be used. 

Theorem 2(b) suggests an algorithm for finding an undirected spanning 
tree for a relation R. Simply remove undirected edges from R until we reach a 
point where removal of one more undirected edge will result in a relation that is 
not connected. The result will be an undirected spanning tree. 


Example 4. In Figure 8.27(a), we repeat the graph of Figure 8.26(a). We then 
show the result of successive removal of undirected edges, culminating in Figure 
8.27(f), the undirected spanning tree, which agrees with Figure 8.26(d). Sd 


This algorithm is fine for small relations whose graphs are easily drawn. For 
large relations, perhaps stored in a computer, it is inefficient because at each 
stage we must check for connectedness, and this in itself requires a complicated 
algorithm. We now introduce a more efficient method, which also yields a span- 
ning tree, rather than an undirected spanning tree. 

Let R be a relation on a set A, and let a,b € A. Let Aj = A — {a, b}, and 
A’ = A, U {a’}, where a’ is some new element not in A. Define a relation R’ on 
A’ as follows. Suppose u,v € A’, u # a’, v # a’. Let (a’ u) € R’ if and only if 
(a, u) © R or (b,u) € R. Let (u, a’) € R’ if and only if (u, a) € R or (u,b) E R. 
Finally, let (u,v) € R’ if and only if (u,v) € R. We say that R’ is a result of merg- 
ing the vertices a and b. This is similar to the merging of vertices discussed in 
Section 6.1. 

Imagine, in the digraph of R, that the vertices are pins, and the edges are 
elastic bands that can be shrunk to zero length. Now physically move pins a and 
b together, shrinking the edge between them, if there is one, to zero length. The 
resulting digraph is the digraph of R’. If R is symmetric, we may perform the same 
operation on the graph of R. 


Example 5. Figure 8,28(a) shows the graph of a symmetric relation R. In Figure 
8.28(b), we show the result of merging vertices vy and v, into a new vertex vj. In 
Figure 8.28(c), we show the result of merging vertices vj and v, of the relation 
whose graph is shown in Figure 8.28(b) into a new vertex vj. Notice in Figure 
8.28(c) that the undirected edges that were previously present between vj and v, 
and between v, and v, have been combined into one undirected edge. a 


The algebraic form of this merging process is also very important. Let us 
restrict our attention to symmetric relations and their graphs. We know from 
Section 4.2 how to construct the matrix of a relation R. 
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a 
b c b c b c 
d e d e d e 
f f f 
(a) (b) (c) 
a a a 
b c b c b c 
4 
d e d é d é 
7 
f f f 
(d) (e) (f) 
Figure 8.27 


If R is a relation on A, we will temporarily refer to elements of A as vertices 
of R. This will facilitate the discussion. 


Suppose now that vertices a and b of a relation R are merged into a new 


vertex a’ that replaces a and b to obtain the relation R’. To determine the matrix 
of R’, we proceed as follows. 


STEP 1. Let row i represent vertex a and row j represent vertex b. Replace row i 
by the join of rows i and j. The join of two n-tuples of 0’s and 1’s has a 1 in some 
position exactly when either of those two v-tuples has a 1 in that position. 


STEP 2. Replace column i by the join of columns i and j, 
Step 3. Restore the main diagonal to its original values in R. 


STep 4. Delete row j and column j. 


vo 
iat 
V9 
¥3 
V4 
v5 
V6 


OoOroorr oO 


OOorrOor 


Vo 


(a) 


mre OOCO- 
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% vg 
v2 v2 
v6 
V5 V5 Vs 
V4 V4 
V6 ¥3 v6 V3 
(b) (c) 


Figure 8.28 


We make the following observation regarding step 3. If e = (a,b) € R and 
we merge a and b, then e would become a cycle of length 1 at a’. We do not want 
to create this situation, since it does not correspond to “shrinking (a, b) to zero.” 
Step 3 corrects for this occurrence. 


Example 6. Figure 8.29 gives the matrices for the corresponding symmetric 
relations whose graphs were given in Figure 8.28. In Figure 8.29(b), we have 
merged vertices v) and v, into vg. Note that this is done by taking the join of the 
first two rows and entering the result in row 1, doing the same for the columns, 
then restoring the diagonal, and removing row 2 and column 2. If vertices vp and 
v, in the graph whose matrix is given by Figure 8.29(b) are merged, the resulting 


graph has the matrix given by Figure 8.29(c). ¢ 
v3 Vg V5 VG Yo Vo V3 Va v5 Ve Vo V3 V4 Vs VW 
0 0 1 O07; wy O 1 1 1 1 Of vot O 1 1 1 1 
1 1 0 OF wit 0 0 O 1 1 vy, 1 0 0 0 O 
0 o 1 1 yl} 1 0 0 0 0 0} whi oo 0 0 0 
0 0 0 Of] wilt oO 0 0 0 O|] wit 0 0 O O 
0 0 0 OF} vs) t t 0 0 O OF vy t 0 0 O O 
0 0 0 Of wlO 1 0 0 0 0 
0 0 0 90 
(a) (b) (c) 

Figure 8.29 


We can now give an algorithm for finding a spanning tree for a symmetric, 
connected relation R on the set A = {v,, v),...,v,}- The method is a special case 
of an algorithm called Prim’s algorithm. The steps are as follows: 


Step 1. Choose a vertex v, of R, and arrange the matrix of R so that the first row 
corresponds to v,. 


318 


Chapter 8 ‘Trees 


STEP 2. Choose a vertex v, of X such that (v,, v,) © R, merge v, and v, into a new 


vertex vj, representing {v,, v,], and replace v, by v;. Compute the matrix of the 
resulting relation R’. Call the vertex v/a merged vertex. 


STEP 3. Repeat steps 1 and 2 on R’ and on all subsequent relations until a rela- 
tion with a single vertex is obtained. At each step, keep a record of the set of 
original vertices that is represented by each merged vertex. 


STEP 4. Construct the spanning tree as follows. At each stage, when merging ver- 


tices a and 6, select an edge in R from one of the original vertices represented 
by a to one of the original vertices represented by b. 


Example 7. We apply Prim’s algorithm to the symmetric relation whose graph 
is shown in Figure 8.30. 


2 d 
Figure 8,30 
In Table 8.1, we show the rnatrices that are obtained when the original set 
of vertices is reduced by merging until a single vertex is obtained, and at each 


stage we keep track of the set of original vertices represented by each merged 
vertex, as well as of the new vertex that is about to be merged. 


Table 8.1 
Original Vertices New Vertex 
Represented by to Be Merged 
Matrix Merged Vertices (with First Row) 
abed 
a{0 011 
b ]0 01 1 — c 
c {1 10 0 
d {1 100 
abd 
a’ [ 0 1 | 
6b {1 0 1 ao b 
qa ll 10 ta, <I 
% 4 
a” a” © {a,c,b d 
d | 1 0] ! 
al” 


a” {0} a” © {a,c,d, b} 
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The first vertex chosen is a, and we choose c as the vertex to be merged with 
a, since there is a 1 at vertex c in row 1. We also select the edge (a, c) from the 
original graph. At the second stage, there is a 1 at vertex b in row 1, so we merge 
b with vertex a’. We select an edge in the original relation R from a vertex of 
{a,c} to b, say (c, 6). At the third stage, we have to merge d with vertex a”. Again, 
we need an edge in R from a vertex of {a, c, b} to d, say (a, d). The selected edges 
(a,c), (c, b), and (a, d) form the spanning tree for R, which is shown in Figure 8.31. 
Note that the first vertex selected becomes the root of the spanning tree that is 


constructed. Cd 
a b 
c d 
Figure 8.31 


EXERCISE SET 8.4 


In Exercises 1 through 6 (Figures 8.32 through 2. Use 5 as the root. 
8.37), use Prim’s algorithm to construct a span- 


1 2 
ning tree for the connected graph shown. Use the 
indicated vertex as the root of the tree and draw 
the digraph of the spanning tree produced. 
5 
1. Use e as the root. 3 4 
a Figure 8.33 
b f 3. Use c as the root. 
a b 
c e 
d c d 


Figure 8.32 Figure 8.34 
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4. Use 4 as the root. 


1 5 
3 4 
2 7 
Figure 8.35 


5. Use e as the root. 


a b c 


Figure 8.36 


6. Use d as the root. 


Figure 8.37 


In Exercises 7 through 12, construct an un- 
directed spanning tree for the connected graph G 
by removing edges in succession, Show the graph 
of the resulting undirected tree. 


7. Let G be the graph shown in Figure 8,32. 


ae 


8. Let G be the graph shown in Figure 8.33. 
9. Let G be the graph shown in Figure 8.34. 
10. Let G be the graph shown in Figure 8.35. 
M1. Let G be the graph shown in Figure 8.36. 
12, Let G be the graph shown in Figure 8.37, 
13. Consider the connected graph shown in Figure 


8.38. Show the graphs of three different undi- 
rected spanning trees. 


b e 
d 
c 8 
Figure 8.38 


14, For the connected graph shown in Figure 8,39, 
show the graphs of all undirected spanning 
trees, 


Figure 8.39 


1S. For the undirected tree shown in Figure 8.40, 
show the digraphs of all spanning trees. How 
many are there? 


1 2 


4 5 
Figure 8.40 
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16. For each of the graphs in Figure 8.41, give all spanning trees, 
Ay Ay Ad 


Ad A3 
A3 


(a) = 44 


Figure 8.41 


17. For each of the graphs in Figure 8.42, how many different spanning trees are there? 


A, 
As Ay Ay Ay 
A A A A 
4 (a) 3 5 th) 4 
Figure 8.42 


18. State your conclusion for Figure 8.42(b) as a theorem and prove it. 


8.5. Minimal Spanning Trees 


In many applications of symmetric connected relations, the (undirected) graph of 
the relation models a situation in which the edges as well as the vertices carry 
information. A weighted graph is a graph for which each edge is labeled with a 
numerical value called its weight. 


Example 1. The small town of Social Circle maintains a system of walking trails 
between the recreational areas in town. The system is modeled by the weighted 
graph in Figure 8.43, where the weights represent the distances in kilometers 
between sites. C 


Figure 8.43 
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Example 2, A communications company is investigating the costs of upgrading 
links between the relay stations it owns. The weighted graph in Figure 8.44 shows 
the stations and the cost in millions of dollars for upgrading each link. 6d 


Figure 8.44 


The weight of an edge (1,, v,) is sometimes referred to as the distance 
between vertices v, and v, A vertex u is a nearest neighbor of vertex v if u and v 
are adjacent and no other vertex is joined to v by an edge of lesser weight than 
(u,v). Notice that, ungrammatically, v may have more than one nearest neighbor. 


Example 3. In the graph showr. in Figure 8.43, vertex C is a nearest neighbor of 
vertex A, Vertices E and G are both nearest neighbors of vertex F. 5 


A vertex v is a nearest neighbor of a set of vertices V = {v,,v.,...,v,J ina 
graph if v is adjacent to some rember v, of V and no other vertex adjacent to a 
member of V is joined by an edge of lesser weight than (¥, v,). 


Example 4. Referring to the graph given in Figure 8.44, let V = (C, EF, J}. Then 
vertex D is a nearest neighbor of V, because (D, E) has weight 2.2 and no other 
vertex adjacent to C, E, or J is linked by an edge of lesser weight to one of these 
vertices, ¢ 


With applications of weighted graphs, it is often necessary to find an undi- 
rected spanning tree for which the total weight of the edges in the tree is as small 
as possible. Such a spanning tree is called a minimal spanning tree. Prim’s algo- 
rithm (Section 8.4) can easily be adapted to produce a minimal spanning tree for 
a weighted graph. We restate Prim’s algorithm as it would be applied to a sym- 
metric, connected relation given by its undirected weighted graph. 


PRIM’S ALGORITHM: Let R be a symmetric, connected relation with n vertices. 
Step 1. Choose a vertex v, of R. Let V = {v,} and E = { }. 


Step 2, Choose a nearest neighbor v, of V that is adjacent to v, v, € V, and for 
which the edge (v, v,) does not form a cycle with members of £. Add v, to V 
and add (v;, v;) to E. 
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Step 3. Repeat step 2 until |E| = — 1. Then V contains all n vertices of R, and 
E contains the edges of a minimal spanning tree for R. 


End of Algorithm 


In this version of Prim’s algorithm, we begin at any vertex of R and con- 
struct a minimal spanning tree by adding an edge to a nearest neighbor of the set 
of vertices already linked, as long as adding this edge does not complete a cycle. 
This is an example of a greedy algorithm. At each stage we chose what is “best” 
based on local conditions, rather than looking at the global situation. Greedy 
algorithms do not always produce optimal solutions, but we can show that in this 
case the solution is optimal. 


Theorem 1. Prim’ algorithm, given above, produces a minimal spanning tree for 
the relation. 


Proof: Let T be the tree produced by Prim’s algorithm for R and let its 
edges be ¢,,t,,...,¢,-,. Suppose that T is not a minimal spanning tree for R. 
Among the minimal spanning trees of R, let S be one with the following 
property: t,,4,...,¢, are edges in S with i <n — 1 as large as possible. That 
is, no minimal spanning tree of R contains ¢,, 4, ..., t, 4,. Now consider 
S U {t,,,}. This graph must contain a simple cycle since it has n edges. The 
situation is illustrated in Figure 8.45. When ¢,,, was selected by Prim’s algo- 
rithm, either s, or s, was also available for selection, say s,, so the weight of 
t,,, is less than or equal to that of s, Thus S — {s,} U {¢,,,} is a minimal span- 
ning tree of R containing 4, t,,..., §, 4.,. But this contradicts the choice of 
i. Hence T is a minimal spanning tree for R. Sd 


Figure 8.45 


Example 5. Social Circle, the town in Example 1, plans to pave some of the 
walking trails to make them bicycle paths as well. As a first stage, the town wants 
to link all the recreational areas with bicycle paths as cheaply as possible. 
Assuming that construction costs are the same on all parts of the system, use 
Prim’s algorithm to find a plan for the town’s paving. 


Solution: Referring to Figure 8.43, if we choose A as the first vertex, the 
nearest neighbor is C, 2 kilometers away. So (A, C) is the first edge selected. 
Considering the set of vertices {A, C}, B is the nearest neighbor, and we may 
choose either (A, B) or (B, C) as the next edge. Arbitrarily, we choose 
(B, C). B is a nearest neighbor for {A, B, C}, but the only edge available 
(A, B) would make a cycle, so we must move to the next nearest neighbor 
and choose (C, F) [or (C, E)]. Figure 8.46(a) through (c) show the begin- 
ning steps and Figure 8.46(d) shows a possible final result. Figure 8.46(e) 
shows a minimal spanning tree using Prim’s algorithm beginning with ver- 
tex E. In either case, the bicycle paths would cover 21 kilometers. 
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(d) (e) 
Figure 8.46 


Example 6. A minimal spanning tree for the communication network in 
Example 2 may be found by using Prim’s algorithm beginning at any vertex. 
Figure 8.47 shows a minimal spanning tree produced by beginning at /. The total 
cost of upgrading these links would be $20,800,000. 


Figure 8.47 


If a symmetric connected relation R has n vertices, then Prim’s algorithm 
has running time O(n”). (This can be improved somewhat.) If R has relatively few 
edges, a different algorithm mav be more efficient. This is similar to the case for 
determining whether a relation is transitive, as seen in Section 4,6. Kruskal’s 
algorithm is another example of a greedy algorithm that produces an optimal 
solution, 


KRUSKAL’S ALGORITHM: Let R te a symmetric, connected relation with n vertices 
and let § = {e,,e,,..., &,} be the set of weighted edges of R. 
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STEP 1. Choose an edge e, in S$ of least weight. Let E = {e,}. Replace S with 
S — {e,}. 


STEP 2. Select an edge e, in S of least weight that will not make a cycle with mem- 
bers of E. Replace E with E U {e, and S with S — {e,}. 


Step 3. Repeat step 2 until |E| =n — 1. 
End of Algorithm 


Since R has n vertices, the n — 1 edges in E will form a spanning tree. The 
selection process in step 2 guarantees that this is a minimal spanning tree. 
(We omit the proof.) Roughly speaking, the running time of Kruskal’s algorithm 
is O(k Ig(k)), where & is the number of edges in R. 


Example 7. A minimal spanning tree from Kruskal’s algorithm for the walking 
trails in Example 1 is given in Figure 8.48. One sequence of edge selections is 
(D, E), (D, #), (A, C), (A, B), (E, G), (E, F), and (C, £) for a total weight of 21 
kilometers. Naturally either of the algorithms for minimal spanning trees should 
produce trees of the same weight. Sd 


Figure 8.48 


Example 8, Use Kruskal’s algorithm to find a minimal spanning tree for the 
relation given by the graph in Figure 8.49. 


Solution: Initially, there are two edges of least weight, (B, C) and (E, F). 
Both of these are selected. Next there are three edges, (A, G), (B, G), and 
(D, E), of weight 12. All of these may be added without creating any cycles. 
Edge (F, G) of weight 14 is the remaining edge of least weight. Adding 
(F, G) gives us six edges for a 7-vertex graph, so a minimal spanning tree 
has been found, a 


Figure 8.49 
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EXERCISE SET 8.5 


In Exercises 1 through 6, use Prim’ algorithm as 6. Let G be the graph shown in Figure 8.51. Begin 

given in this section to find a minimal spanning at M. 

tree for the connected graph indicated. Use the 

specified vertex as the initial vertex. In Exercises 7 through 9, use Kruskal’s algo- 
1. Let G be the graph shown in Figure 8.43. Begin fila to finden patnemal spanmins ace Jor ite 


indicated graph. 
7. Let G be the graph shown in Figure 8.44. 


at F. 


2. Let G be the graph shown in Figure 8.44. Begin 


at A. 8. Let G be the graph shown in Figure 8.50. 
3. Let G be the graph shown in Figure 8.49. Begin 9. Let G be the graph shown in Figure 8.51. 

at G. 

10. The distances between eight cities are given in 

4. Let G be the graph shown in Figure 8.50. Begin the table on page 327. Use Kruskal’s algorithm 

at E. to find a minimal spanning tree whose vertices 

are these cities. What is the total distance for 

5. Let G be the graph shown in Figure 8.51. Begin the tree? 

at K. 


Figure 8.51 


Abbeville = Aiken Allendale 

Abbeville 69 121 
Aiken 69 52 
Allendale 121 52 

Anderson 30 97 149 
Asheville 113 170 222 
Athens 70 117 160 
Atlanta 135 163 206 
Augusta 63 16 59 

11. Suppose that in constructing a minimal span- 


ning tree a certain edge must be included. Give 
a modified version of Kruskal’s algorithm for 
this case. 


Redo Exercise 10 with the requirement that the 
route from Atlanta to Augusta must be included. 
How much longer does this make the tree? 


Modify Kruskal’s algorithm so that it will pro- 


duce a maximal spanning tree, that is, one with 
the largest possible sum of the weights. 


14 


Suppose that the graph in Figure 8.51 repre- 
sents possible flows through a system of pipes. 
Find a spanning tree that gives the maximum 
possible flow in this system. 


KEY IDEAS FOR REVIEW 


@ Tree: relation on a finite set A such that there 
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Anderson Asheville Athens Atlanta Augusta 
30 113 70 135 63 
97 170 117 163 16 
149 222 160 206 59 
92 63 122 93 
92 155 204 174 
63 155 66 101 
122 204 66 147 
93 174 101 147 


exists a vertex ¥) © A with the property that 

there is a unique path from vy to any other ver- 

tex in A and no path from vy to vp 

Root of tree: vertex vy in the preceding defini- 

tion 

Rooted tree (T, vq): tree T with root vy 

Theorem. Let (T, vo) be a rooted tree. Then 

(a) There are no cycles in T. 

(b) vo is the only root of T. 

(c) Each vertex in J, other than vo, has in- 
degree one, and vy has in-degree zero. 

Level: see page 287 

Leaves: vertices having no offspring 


+ 
+ 


+ 
+ 
+ 
+ 


15. Modify Prim’s algorithm as given in this section 
to find a maximal spanning tree. 

16. Use the modified Prim’s algorithm from 

Exercise 15 to find a maximal spanning tree for 

the graph in Figure 8.51. 

17. In Example 5, two different minimal spanning 

trees for the same graph were displayed. When 

will a weighted graph have a unique minimal 

spanning tree? Give reasons for your answer. 


18. Modify Prim’s algorithm to handle the case of 
finding a maximal spanning tree if a certain 


edge must be included in the tree. 


Theorem. Let T be a rooted tree on a set A. Then 

(a) T is irreflexive. 

(b) Tis asymmetric. 

(c) If (a, b) © T and (b, c) © T, then 
(a,c) € T, for alla, b, and cin A. 

n-tree: tree in which every vertex has at most n 

offspring 

Binary tree: 2-tree 

Theorem. If (7, vg) is a rooted tree and v & T, 

then 7(v) is also a rooted tree with root v. 

T(v): subtree of T beginning at v 

Positional binary tree: see page 294 

Computer representation of trees: see page 295 

Preorder search: see page 300 
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Inorder search: see page 303 

Postorder search: see page 303 

Reverse Polish notation: see page 304 
Searching general trees: see page 304 
Linked-list representation of a tree: see page 
306 

Undirected tree: symmetric closure of a tree 
Simple path: No two edges correspond to the 
same undirected edge. 

Connected symmetric relation R: There is a 
path in R from any vertex to any other vertex. 
Theorem: A tree with » vertices has n — 1 edges. 
Spanning tree for symmetric connected relation 
R: tree reaching all the vertices of R and whose 
edges are all edges of R 


CODING EXERCISES 


For each of the following, write the requested pro- 
gram or subroutine in pseudocode (as described in 
Appendix A) or in a programming language that 
you know. Test your code either with a paper-and- 
pencil trace or with a computer run. 


1. 


Use the arrays LEFT, DATA, and RIGHT 
(Section 8.2) in a program to store letters so 
that a postorder traversal of the tree created 
will print the letters out in alphabetical order. 


. Write a program that, with input of an ordered 


tree, has as output the corresponding binary 
positional tree (as described in Section 8.3). 


+ 


+ 
+ 


+ 


+ 
+ 


5. 


Undirected spanning tree: symmetric closure of 
a spanning tree 

Prim’s algorithm: see page 317 

Weighted graph: a graph whose edges are each 
labeled with a numerical value 

Distance between vertices v; and v;,: weight of 
(¥;, ¥))- 

Nearest neighbor of v: see page 322 

Minimal spanning tree: undirected spanning 
tree for which the total weight of the edges is as 
small as possible 

Prim’s algorithm (second version): see page 322 
Greedy algorithm: see page 323 

Kruskal’s algorithm: see page 324 


. Write a subroutine to carry out the merging of 


vertices as described in Prim’s algorithm on 
page 317. 


. Write code for the second version of Prim’s 


algorithm (Section 8.5). 


Write code for Kruskal’s algorithm. 


CHAPTE 


Prerequisite: Chapter 7 


The notion of a mathematical structure was introduced in Section 1.6. In the fol- 
lowing chapters, other types of mathematical systems were developed, some such 
as [propositions, A, V, ~] were not given specific names, but others such as B,, 
the Boolean algebra on n elements, were named. In this chapter, we identify two 
more types of mathematical structures, semigroups and groups. Semigroups will 
be used in our study of finite-state machines in Chapter 10. We also develop the 
basic ideas of group theory, which we will apply to coding theory in Chapter 11. 


9.1. Binary Operations Revisited 


We defined binary operations earlier (see Section 1.6) and noted in Section 5.2 
that a binary operation may be used to define a function. Here we turn the pro- 
cess around and define a binary operation as a function with certain properties. 
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A binary operation on a set A is an everywhere defined function 
f: A X A— A. Observe the following properties that a binary operation must satisfy: 


1. Since Dom(f) = A X A, f assigns an element f(a, b) of A to each 
ordered pair (a, b) in A X A. That is, the binary operation must be 
defined for each ordered pair of elements of A. 

2. Since a binary operation is a function, only one element of A is assigned 
to each ordered pair. 


Thus we can say that a binary operation is a rule that assigns to each 
ordered pair of elements of A a unique element of A. The reader should note that 
this definition is more restrictive than that given in Chapter 1, but we have made 
the change to simplify the discussion in this chapter. We shall now turn to a num- 
ber of examples. 

It is customary to denote binary operations by a symbol such as +, instead 
of f, and to denote the elemerit assigned to (a, b) by a * 6 [instead of *(a, b)]. It 
should be emphasized that if @ and b are elements in A, then a * b € A, and this 
property is often described by saying that A is closed under the operation +. 


Example 1. Let A = Z. Define a * b as a + b. Then * is a binary operation 
on Z. ad 


Example 2. Let A = R. Defire a * b as a/b. Then * is not a binary operation, 
since it is not defined for every ordered pair of elements of A. For example, 3 + 0 
is not defined, since we cannot divide by zero. ¢ 


Example 3. Let.A = Z*. Define a * b as a — b. Then * is not a binary operation 
since it does not assign an eleinent of A to every ordered pair of elements of 
A; for example,2 #5 € A. Ca 


Example 4, Let A = Z. Define a « b as a number less than both a@ and b. Then 
* is not a binary operation, since it does not assign a unique element of A to each 
ordered pair of elements of A; for example, 8 « 6 could be 5, 4, 3, 1, and so on. 
Thus, in this case, * would be a relation from A X A to A, but not a function. @ 


Example 5. Let A = Z. Define a * b as max{a, b}. Then * is a binary operation; 
for example, 2 « 4 = 4, —3 * (-5) = —3. e 


Example 6. Let A = P(S), for some set S. If V and W are subsets of S, define 
V « Was V U W. Then * is a binary operation on A. Moreover, if we define 
V* Was V1 W, then « is another binary operation on A. Sd 


As Example 6 shows, it is possible to define many binary operations on the 
same set. 


Example 7. Let M be the se: of all n X n Boolean matrices. Define A * B 
as A V B (see Section 1.5). Then * is a binary operation. This is also true of 
AAB. ° 
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Example 8. Let L be a lattice. Define a « b as a /\ b (the greatest lower bound 
of a and b). Then * is a binary operation on L. This is also true of a V b (the least 


upper bound of a and b). ° 
Tables 
If A = {a,,a,...,4,} is a finite set, we can define a binary operation on A by 


means of a table as shown in Figure 9.1. The entry in position i,j denotes the ele- 
ment a; * a; 


Figure 9.1 


Example 9. Let A = (0, 1}. We define the binary operations V and / by the fol- 
lowing tables: 


Vio 1 A|oO 1 
0]; oOo 1 0 | 0 oO 
1/1 1 1/0 1 od 


If A = (a, b}, we shall now determine the number of binary operations that 
can be defined on A. Every binary operation * on A can be described by the table 


* ab 
a 
5 
Since every blank can be filled in with the clement a or b, we conclude that there 


are 2+ 2-2-2 = 24 or 16 ways to complete the table. Thus there are 16 binary 
operations on A. 


Properties of Binary Operations 


Several of the properties defined for binary operations in Section 1.6 are of par- 
ticular importance in this chapter. We repeat them here. 
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A binary operation on a set A is said to be commutative if 
axb=b*a 


for all elements a and b in A. 


Example 10, The binary operation of addition on Z (as discussed in Example 1) 
is commutative. Sd 


Example 11. The binary operation of subtraction on Z is not commutative, 
since 
BSS #32: ¢ 
A binary operation that is described by a table is commutative if and only 
if the entries in the table are syinmetric with respect to the main diagonal. 


Example 12. Which of the following binary operations on A = {a, b,c, d} are 
commutative? 


ror oe ols 
ae 


Solution: The operation in (a) is not commutative, since a « b is c while 
b * ais b. The operation in (b) is commutative, since the entries in the table 
are symmetric with respect to the main diagonal. ° 


A binary operation * on a set A is said to be associative if 
a«(b*c)=(a*b)*c 
for all elements a,b, and cin A. 


Example 13. The binary operation of addition on Z is associative. od 


Example 14. The binary operation of subtraction on Z is not associative, since 
2—(3-5)#(2-3)-5. Sf 


Example 15. Let L be a lattice. The binary operation defined bya *b =a/Nb 
(see Example 8) is commutative: and associative. It also satisfies the idempotent 
property a /\ a = a.A partial converse of this example is also true, as shown in 
Example 16. ¢ 


Example 16. Let * be a binary operation on a set A, and suppose that * satisfies 
the following properties for any a, b, and c in A. 


l.a=a*a Idempotent property 
2,.a*b=b*a Commutative property 


3. a*(b*c) =(a* by *c 
Define a relation = on A by 


asb 
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Associative property 


ifand only if a=a*b. 


Show that (A, =) is a poset, and for all a, b in A, GLB(a, b) = ax b. 


Solution: We must show that = is reflexive, antisymmetric, and transitive. 
Since a = a* a,a =a for all ain A, and < is reflexive. 
Now suppose that a = b and b = a. Then, by definition and property 


2,a=axb=bxa 


b,so a = b. Thus & is antisymmetric. 


Ifa<bandb <c,thena=a*b=ax(b*c) = (a*b)*c=a*c,s8o 


a =cand < is transitive. 


Finally, we must show that, for all a and bin A,a*b=a/b 
(the greatest lower bound of a and b with respect to =). We have a * b = 
a*(b * b) = (a * b) * b,soa* b S b. In a similar way, we can show that 
a*b=a,soa* bisa lower bound for a and b. Now, ifc = aandc = b, then 
c=c*aandc =c « b by definition. Thus c = (c * a) * b = c x (a * b), s0 
c = a* b, This shows that a * b is the greatest lower bound ofa@andb. @ 


EXERCISE SET 9.1 


In Exercises 1 through 8, determine whether the 
description of * is a valid definition of a binary 
operation on the set. 


1. On R, where a « b is ab (ordinary multiplica- 
tion). 


2. On Z*, where a « b is a/b. 
3. On Z, where a « bisa’. 

4. On Z*, where a « bis a’. 

5. On Z*, where a * bisa — b. 


6. On R, where a * b isa Vb. 


~ 


. On R, where a x 5 is the largest rational num- 
ber that is less than ab. 


8. On Z, where a * b is 2a + b. 


In Exercises 9 through 17, determine whether the 
binary operation * is commutative and whether 
it is associative on the set. 


9 On Z*, where ax bisa +b +2. 


10. On Z, where a@ « b is ab. 
11. On R, where a * bisa x |d|. 


12. On the set of nonzero real numbers, where 
ax bisa/b. 


13. On R, where a * b is the minimum of a and b. 


14, On the set of all x < m Boolean matrices, where 
A «Bis A © B (see Section 1.5). 


15. On R, where a « b is ab/3. 
16. On R, where a *« bis ab + 2b. 
17. On a lattice A, where a « bisa V b. 


18. Fill in the following table so that the binary 
operation * is commutative. 
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19. Consider the binary operation * defined on the 
set A = {a, b,c, d} by the following table. 


Compute 

(a) cx danddxc, 

(b) b* dand dx b. 

(c) ax (b*c) and (a*b) «ec. 

(d) Is * commutative; associative? 


In Exercises 20 and 21, complete the given table 
so that the binary operation « is associative. 


22. Let A be a set with # elements. 


(a) How many binary operations can be 
defined on A? 

(b) How many commutative binary operations 
can be defined on A? 


23. Let A = {a,b}. 


(a) Make a table for each of the 16 binary 
operations that can be defined on A. 

(b) Using part (a), identify the binary opera- 
tions on A that are commutative. 

(c) Using part (a), identify binary operations 
on A that are associative. 

(d) Using part (a), identify the binary opera- 
tions on A that satisfy the idempotent 
property. 


24. Let * be a binary operation on a set A, and sup- 
20. x*l|a bcd an . 
pose that * satisfies the idempotent, commuta- 
ala bc d tive, and associative properties, as discussed in 
b|b ade Example 16. Define a relation = on A bya = b 
c|c dab if and only if b = a * b, Show that (A, =) isa 
d poset and, for all a and 6, LUB(a, b) = a b. 
21. * b d 25. Describe how the definition of a binary opera- 
ala a tion on aset A is different from the definition 
BAR ca aed of a binary operation given in Section 1.6, 
Explain also whether a binary operation on a 
c set is or is not a binary operation according to 
did ccd 


9.2. Semigroups 


the earlier definition. 


In this section we define a simple mathematical system, consisting of a set together 
with a binary operation, that has many important applications. 

A semigroup is a nonempty set § together with an associative binary oper- 
ation * defined on S. We shall denote the semigroup by (5, *) or, when it is clear 
what the operation * is, simply bv S. We also refer to a * 6 as the product of a and 
b. The semigroup (5S, *) is said to be commutative if * is a commutative operation. 


Example 1. It follows from Section 9.1 that (Z, +) is a commutative semi- 
group. ¢ 


Example 2. The set P(S), where S is a set, together with the operation of union 
is a commutative semigroup. 


Example 3. The set Z with the binary operation of subtraction is not a semi- 
group, since subtraction is not associative. 
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Example 4. Let § be a fixed nonempty set, and let $° be the set of all functions 
f:S— S.lffand g are elements of S*, we define f * g as f° g, the composite func- 
tion. Then * is a binary operation on S*, and it follows from Section 4.7 that « is 
associative. Hence (S°, *) is a semigroup. The semigroup S* is not commutative. 


¢ 
Example 5. Let (L, =) be a lattice. Define a binary operation on L by a * b = 
a\ b.Then L is a semigroup. Sd 
Example 6. Let A = {a,, a,...,a,} be a nonempty set. Recall from Section 1.3 


that A* is the set of all finite sequences of elements of A. That is, A* consists of 
all words that can be formed from the alphabet A. Let @ and B be elements of 
A*, Observe that catenation is a binary operation - on A*. Recall that if a = 
a,a,°°* a, and B = bb, --+ b,, then a+ B = a,a,--*a,b,b,--- b,. It is easy to see 
that if a, B, and y are any elements of A*, then 


ar (B+ y)=(a- Bry 


so that is an associative binary operation, and (A*, -) is a semigroup. The semi- 
group (A%*, -) is called the free semigroup generated by A. ¢ 


In a semigroup (S, *) we can establish the following generalization of the 
associative property; we omit the proof. 


Theorem1. If a,,4),...,4,," = 3, are arbitrary elements of a semigroup, then all 
products of the elements a), a),..., 4, that can be formed by inserting meaningful 
parentheses arbitrarily are equal. Sa 


If a,,a,...,4,, are elements in a semigroup (S, *), we shall write their prod- 
uct as 


4, * A, °° *G,, 

omitting the parentheses. 

Example 7. Theorem 1 shows that the products 

((@, ¥ Gy) * G3) * Oy, a, * (a, * (a3 * a4), (a, * (dy * @s)) * a, 
are all equal. o 
An element e in a semigroup (5S, *) is called an identity element if 

e*a=a*xe=a 

for all a € S. As shown by Theorem 1, Section 1.6, an identity element must be 

unique. 


Example 8. The number 0 is an identity in the semigroup (Z, +). ° 


Example 9. The semigroup (Z*, +) has no identity element. e 


A monoid is a semigroup (5S, *) that has an identity. 
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Example 10. The semigroup :?(.S) defined in Example 2 has the identity @, since 
OxA=QGIA=A=AUBD=AxD 
for any element A € P(S). Hence P(S) is a monoid. Sd 


Example 11. The semigroup S* defined in Example 4 has the identity 1,, since 
Ise f= lsefafafels=fels 
for any element f € S° is a monoid. o 


Example 12. The semigroup A* defined in Example 6 is actually a monoid with 
identity A, the empty sequence, since a: A = A+ a= a forall a € A*. 4 


Example 13, The set of all relations on a set A is a monoid under the operation 
of composition. The identity element is the equality relation A (see Section 
47). + 


Let (S, +) be a semigroup and let T be a subset of S$. If Tis closed under the 
operation * (that is, a « b € T whenever a and b are elements of T), then (T, *) 
is called a subsemigroup of (S, «). Similarly, let (S, «) be a monoid with identity e, 
and let T be a nonempty subse: of S. If T is closed under the operation + and 
e & T, then (T, *) is called a submonoid of (S, «). 

Observe that the associative property holds in any subset of a semigroup so 
that a subsemigroup (T, +) of a semigroup (5S, *) is itself a semigroup. Similarly, a 
submonoid of a monoid is itself a monoid. 


Example 14. If (5S, *) is a semigroup, then (S, *) is a subsemigroup of (S, *). 
Similarly, let (S, *) be a monoid. Then (5, *) is a submonoid of (S, *), and if 
T = {e}, then (T, *) is also a submonoid of (5, *). ¢ 


Suppose that (S, *) is a semigroup, and let a € S. Forn € Z*, we define the 
powers of a” recursively as follows: 
a=a., a’ =a" xa, n=2., 


Moreover, if (5, *) is a monoid, we also define 
ad =e, 
It can be shown that if m and n are nonnegative integers, then 
a «x a™ =a", 
Example 15 
(a) If (S, *) is a semigroup, a € S', and 
T= {a liez*}, 
then (T, *) is a subsemigroup of (S, *). 
(b) If (S, *) is a monoid, a € S, and 
T = {a' |i Z* ori = 0}, 
then (T, *) is a submonoid of (S, *). og 
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Example 16, If Tis the set of all even integers, then (7, X) is a subsemigroup of 
the monoid (Z, X), where X is ordinary multiplication, but it is not a submonoid 
since the identity of Z, the number 1, does not belong to T. . 


Isomorphism and Homomorphism 


An isomorphism between two posets was defined in Section 7.1 as a one-to-one 
correspondence that preserved order relations, the distinguishing feature of 
posets. We now define an isomorphism between two semigroups that preserves 
the binary operations. In general, an isomorphism between two mathematical 
structures of the same type should preserve the distinguishing features of the 
structures. 

Let (S, *) and (T, *’) be two semigroups. A function f: S > T is called an 
isomorphism from (S, «) to (T, *’) if it is a one-to-one correspondence from S to 
T, and if 

f(a* b) = f(a) *' f(b) 
for all a and bin S. 

If fis an isomorphism from (5S, *) to (T, *'), then, since fis a one-to-one cor- 
respondence, it follows from Theorem 1 of Section 5.1 that f ~! exists and is a one- 
to-one correspondence from T to S. We now show that f~! is an isomorphism 
from (T, *') to (S, *). Let a’ and b’ be any elements of T. Since f is onto, we can 
find clements a and bin S such that f(a) = a’ and f(b) = b’. Then a = f ~'(a’) and 
b = f -1(b’). Now 

fa’ *' b') = f-'(f(a) * f(b) 
= f-'(f(a *b)) 
=(ftef)(a*b) 
=asb=f(a')x fb) 
Hence f~' is an isomorphism. 

We now merely say that the semigroups (S, *) and (T, «’) are isomorphic 
and we write S = T. 

To show that the semigroups (5S, *) and (T, *’) are isomorphic, we must use 
the following procedure: 


STEP 1. Define a function f: § ~ T with Dom(f) = S. 
Step 2. Show that f is one to one. 

STEP 3. Show that f is onto. 

STEP 4, Show that f(a « b) = f(a) *' f(b). 


Example 17. Let T be the set of all even integers. Show that the semigroups 
(Z, +) and (T, +) are isomorphic. 


Solution 
SreP 1. We define the function f: Z — T by f(a) = 2a. 
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STEP 2. We now show that fis one to one as follows. Suppose that f(a,) = 
f(a). Then 2a, = 2a), 80 a, = a). Hence f is one to one. 


STEP 3. We next show that f is onto. Suppose that b is any even integer. 
Then a = b/2 © Zand 


fla) = f(b/2) = 2(b/2) = b, 
so f is onto. 
STEP 4. We have 


f(a + b) = 2(a + b) 
= 2a + 2b = f(a) + f(d). 


Hence (Z, +) and (7, + ) are isomorphic semigroups. Sd 


In general, it is rather straightforward to verify that a given function 
f:S-— T is or is not an isomorphism. However, it is generally difficult to show that 
two semigroups are isomorphic, because one has to create the isomorphism f. 

As in the case of poset or lattice isomorphisms, when two semigroups (5, *) 
and (7, *’) are isomorphic, they can differ only in the nature of their elements; 
their semigroup structures are identical. If § and 7 are finite semigroups, their 
respective binary operations can be given by tables. Then S and T are isomorphic 
if we can rearrange and relabel the elements of § so that its table is identical with 
that of 7. 


Example 18. Let § = {a, b,c} and T = {x, y, z}. It is easy to verify that the fol- 
lowing operation tables give semigroup structures for S and T, respectively. 


*|a bc 
ala be 
bb} b ¢ a 
elec ab 
Let 
f@=y 
f(b) =x 
f(c) =z. 
Replacing the elements in S by their images and rearranging the table, we obtain 
exactly the table for 7. Thus S and T are isomorphic. ¢ 


Theorem 2. Let (S, +) and (T, *') be monoids with identities e and e’, respectively. 
Let f: S — T be an isomorphism. Then f(e) = e’. 


Proof: Let b be any element of T. Since f is onto, there is an element a in 
S such that f(a) = b. Then. 
a=a*e 
b = f(a) = f(a * e) = f(a) *’ fe) 
= b»' fle). 
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Similarly, since a = e * a, b = f(e) *’ b. Thus for any b € T, 
b = b»*’ f(e) = f(e) *' b. 
which means that f(e) is an identity for T. Thus it follows that f(e) = e’. @ 


If (S, *) and (T, *') are semigroups such that S has an identity and T does 
not, it then follows from Theorem 2 that (S, *) and (7, *’) cannot be isomorphic. 


Example 19. Let T be the set of all even integers and let X be ordinary multi- 
plication. Then the semigroups (Z, X) and (T, X) are not isomorphic, since Z has 
an identity and T does not. 4 


By dropping the conditions of one to one and onto in the definition of an 
isomorphism of two semigroups, we get another important method for compar- 
ing the algebraic structures of the two semigroups. 

Let (S, *) and (T, +’) be two semigroups. An everywhere-defined function 
f:S— Tis called a homomorphism from (5S, «) to (7, *’) if 

f(a * b) = f(a) *' f(b) 

for all a and b in S. If fis also onto, we say that T is a homomorphic image of S. 
Example 20. Let A = {0,1} and consider the semigroups (A*, +) and (A, +), 
where - is the catenation operation and + is defined by the table 

+/0 1 
0;0 1 
1,1 0 
Define the function f: A* - A by 
1 if a has an odd number of 1’s 


f(a) = | 


0 if a has an even number of 1’s. 
It is easy to verify that a and B are any elements of A*, then 
fla: B) = f(a) + f(B). 


Thus f is a homomorphism. The function f is onto since 


F(0) =0 
fajy=1 
but f is not an isomorphism, since it is not one to one. ¢ 


The difference between an isomorphism and a homomorphism is that an 
isomorphism must be one to one and onto. For both an isomorphism and a homo- 
morphism, the image of a product is the product of the images. 

The proof of the following theorem, which is left as an exercise for the reader, 
is completely analogous to the proof of Theorem 2. 


Theorem 3. Let (S, *) and (T, *') be monoids with identities e and e', respectively. 
Let f: S— T be a homomorphism from (S, *) onto (T,*'). Then fle) =e’. a 
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Theorem 3, together with the following two theorems, shows that, if a semi- 
group (T, *’) is a homomorphic image of the semigroup (5S, *), then (7, *’) has a 
strong algebraic resemblance to (S, *). 


Theorem 4. Let f be a homomorphism from a semigroup (S, *) to semigroup 
(T, *’). If S' is a subsemigroup of (S, *), then 


f(S’) = {rE T | t = f(s) for somes ES’), 
the image of S' under f, is a subsemigroup of (T, *'). 


Proof: If t, and t, are any elements of f(S’), then there exist s, and s, in S’ 


with 
t= f(s) and f = f(s). 
Then 
t * t = f(s) *” F(s9) 
= f(s, * 52) 
= f (53), 


where 53 = s, * 5, € S’. Hence ¢, *’ t, € f(S’). 
Thus f(S') is closed under the operation »’. Since the associative prop- 
erty holds in T, it holds in f($'),so f(S’) is a subsemigroup of (T,*'). @ 
Theorem 5. [ff is a homomorphism from a commutative semigroup (S, *) onto 
a semigroup (T, *'), then (T, *') is also commutative. 


Proof: Let t, and t, be any elements of T. Then there exist s, and s,in $ 


with 
th =f(s) and t, = f(s). 
Therefore, 
t*' th = f(s) *’ f(%) 
= f(s; * 52) 
= f(s, * 54) 
= f(s.) *' f(s) 
=1,%'t. 
Hence (7, *’) is also commutative. . 
EXERCISE SET 9.2 
1. Let A = {a,b}. Which of the following tables 
define a semigroup on A? Which define a 
monoid on A? 
«lab «lab «lab lab *la b *la b 
al|a b aja b a|b a ala 6b ala a a/b b 
blaa bib b bla b b|b a b\|b b blaa 


In Exercises 2 through 12, determine whether the 
set together with the binary operation is a semi- 
group, a monoid, or neither. If it is a monoid, 
specify the identity. If it is a semigroup or a 


monoid, determine if it is commutative. 


2. 


3. 


5. 


7. 


14 


Z*, where * is defined as ordinary multiplica- 
tion. 


Z*, where a « b is defined as max{a, b}. 
Z', where a x b is defined as GCD{a, b}. 
Z* where a x b is defined as a. 


The nonzero real numbers, where * is ordinary 
multiplication. 


P(S), with S a set, where « is defined as inter- 
section. 


. A Boolean algebra B, where a » b is defined as 


a/\b. 


S = {1,2,3, 6, 12}, where @ * b is defined as 
GCD¢(a, b). 


S = {1,2, 3,6, 9, 18}, where a * b is defined as 
LCM(a, b). 


Z, where ax b = a+b — ab. 


: : 2 ab 
The even integers, where a * b is defined as on 


. Which of the following tables defines a semi- 


group? 


* 


(a) (b) 


Complete the following table to obtain a semi- 
group. 


15, 


16. 


17 


° 


18. 


19, 


20 


21 


22. 


23 


24, 
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Let S = {a, b}. Write the operation table for the 
semigroup S°. Is the semigroup commutative? 


Let S = {a, b}. Write the operation table for the 
semigroup (P(S), U). 


Let A = {a, b,c] and consider the semigroup 
(A*, +), where - is the operation of catenation. 
If a = abac, B = cba,and y = babc, compute 


(a)(a* B)+y (b)y-(a-a) ()(y*B)a. 


Prove that the intersection of two subsemi- 
groups of a semigroup (S, *) is a subsemigroup 
of (S, *). 


Prove that the intersection of two submonoids 
of a monoid (S, *) is a submonoid of (S, *). 


Let A = {0,1}, and consider the semigroup 
(A*, -), where - is the operation of catenation. 
Let T be the subset of A* consisting of all 
sequences having an odd number of 1’s. Is 

(T, -) a subsemigroup of (A, -)? 


Let A = {a, 5}. Are there two semigroups (A, *) 
and (A, *’) that are not isomorphic? 


An element x in a monoid is called an idempo- 
tent if x’ = x « x = x. Show that the set of all 
idempotents in a commutative monoid S is a 
submonoid of S. 


Let (S;, *1), (S,, *)), and (S;, #3) be semigroups 
and f: $, > S, and g: S, > S, be homomor- 
phisms. Prove that g o fis a homomorphism 
from S, to S,, 


Let (S,, *), (S,, *”), and (55, *”’) be semigroups, 
and let f: S, + S, and g : S, - 8, be isomor- 
phisms. Show that g of: S, - S, is an isomor- 
phism. 


Let R* be the set of all positive real numbers. 
Show that the function f: R* — R defined by 
f(@) = Inx is an isomorphism of the semigroup 
(R*, X) to the semigroup (R, +), where X and 
+ are ordinary multiplication and addition, 
respectively. 
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In this section we shall obtain new semigroups from existing semigroups. 


Theorem 1. /f (S,*) and (7, *’) are semigroups, then (S X T, *”) is a semigroup, 
where *” is defined by (s,, t,) *” (S, t) = (81 * 85 ty *” th). 


Proof: The proof is left as an exercise. e 


It follows at once from Theorem 1 that if S and T are monoids with identi- 
ties e, and e,, respectively, then S x T is a monoid with identity (e,, e,). 

We now turn to a discussion of equivalence relations on a semigroup (5, *). 
Since a semigroup is not merely a set, we shall find that certain equivalence rela- 
tions on a semigroup give additional information about the structure of the semi- 
group. 

An equivalence relation R on the semigroup (5S, *) is called a congruence 
relation if 


aRa’ and bRb’ imply (a* b)R(a’ xb’). 


Example 1. Consider the semigroup (Z, +) and the equivalence relation R on 
Z defined by 


aRb itandonlyif a=b (mod 2). 


Recall that we discussed this equivalence relation in Section 4.5. Note that if a and 
b yield the same remainder wher divided by 2, then 2 | (a — b). We now show that 
this relation is a congruence relation as follows. 

If 


a=b6b (mod2) and c=d (mod 2), 
then 2 divides a — b and 2 divides c — d,so 
a-~b=2m and c—d=2nhn, 
where m and n are in Z. Adding, we have 
(a- b) +(c-— d)=2m+2n 


or 
(a+c)- (b+ d)=2(m+n), 
so 
at+c=b+d (mod2), 
Hence the relation is a congruence relation. ¢ 


Example 2. Let A = {0,1} and consider the free semigroup (A*, +) generated by 
A. Define the following relation on A: 


aRB ifandonlyif a and 8 have the same number of 1’s. 
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Show that R is a congruence relation on (A*, *). 


Solution: We first show that R is an equivalence relation. We have 

1. aRa for any ae A*. 

2. If a R B, then a and B have the same number of 1’s,so 6 R a. 

3. Ifa R Band BR y, then a and B have the same number of 1’s and 8 and 
y have the same number of 1’s,so a and y have the same number of 1’s. 
Hence aR y. 

We next show that R is a congruence relation. Suppose that a R a’ and 

BR p’. Then a and a’ have the same number of 1’s and B and PB’ have the 

same number of 1’s. Since the number of 1’s in a + Bis the sum of the num- 

ber of 1’s in a and the number of 1’s in 8, we conclude that the number of 

1’s in a - Bis the same as the number of 1’s in a’ + B’. Hence 


(a+ B)R (a: B’) 


and thus R is a congruence relation. Sa 


Example 3. Consider the semigroup (Z, +), where + is ordinary addition. Let 
f(x) =x? — x — 2. We now define the following relation on Z: 
aRb ifandonlyif f(a) = f(b). 


It is straightforward to verify that R is an equivalence relation on Z. However, R 
is not a congruence relation since we have 


“1R2 — (f(-1) = f(2) = 9) 


and 
~2R3  (f(—2) = f(3) = 4) 
but 
—3 RS, 
since f(—3) = 10 and f(5) = 18. °° 


Recall from Section 4.5 that an equivalence relation R on the semigroup 
(S, *) determines a partition of S. We let [a] = R(a) be the equivalence class con- 
taining a and S/R denote the set of all equivalence classes. The notation [a] is 
more traditional in this setting and produces less confusing computations. 


Theorem 2. Let R be a congruence relation on the semigroup (S,*). Consider the 
relation @ from S/R X S/R to S/R in which the ordered pair (({a], [b]) is, for a and 
b in S, related to [a * b]. 
(a) @ is a function from S/R x S/R to S/R, and as usual we denote 
@ ((a], (5]) by [a] @ [5]. Thus [a] @ [b] = [a * b]. 
(b) (S/R, @) is a semigroup. 
Proof: Suppose that ((a], [b]) = ([a’], [b’]). Then a R a’ and b R b’, so we 
must have a « b R a’ * b’, since R is a congruence relation. Thus (a * 5] = 
(a’ * b’}; that is, @® is a function. This means that @ is a binary operation on 
S/R. 
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Next, we must verify that @ is an associative operation. We have 


(a] © ([b] @ [e]) = [a] © [5 * c] 
= [a+ (b*c)] 
= [(a* b)*c] by the associative property of * in § 
= [a+ 5) @ [c] 
= ((e] ® [b)) @ [ce]. 
Hence S/R is a semigroup. We call S/R the quotient semigroup or factor 
semigroup. Observe that @ is a type of “quotient binary relation” on S/R 


that is constructed from the original binary relation * on S by the congru- 
ence relation R. 


Corollary 1. Let R be a congruence relation on the monoid (S,*). If we define the 
operation @® in SIR by [a] @ [E] = [a * b], then (S/R, @) is a monoid. 


Proof: If e is the identity in (S, *), then it is easy to verify that [e] is the 
identity in (S/R, @). a 


Example 4. Consider the situation in Example 2. Since R is a congruence rela- 
tion on the monoid § = (A*, -), we conclude that (S/R, ©) is a monoid, where 


[a] © [8] = [a B]. © 


Example 5. As has already been pointed out in Section 4.5, we can repeat 
Example 4 of that section with the positive integer n instead of 2. That is, we 
define the following relation on the semigroup (Z, +): 


aRb ifandonlyif a=b (modn). 


Using exactly the same method as in Example 4 in Section 4.5, we show that R 
is an equivalence relation and, as in the case of n = 2, a = b (mod n) implies 
n | (a — b). Thus, if 7 is 4, then 


2=6 (mod 4) 


and 4 divides (2 — 6). We also leave it for the reader to show that =(mod n) is a 
congruence relation on Z. 

We now tet n = 4 and we compute the equivalence classes determined by 
the congruence relation =(mod 4) on Z. We obtain 


(0] = (...,-8, 4.0, 4,8, 12,...} = [4] = [8] = ++ 


(1] = {...,-7, -3. 1, 5,9, 13,...} = [5] = [9] =-- 
[2] = (..., -6, -2. 2, 6,10, 14,.. .} = [6] = [10] = 
[3] ={(..., -5,-1,3,7,11,15,...) = [7] = (11) = 


These are all the distinct equivalence classes that form the quotient set 
Z/ =(mod 4). [t is customary to denote the quotient set Z/ =(mod n) by Z,,; Z,, is 
a monoid with operation @ and identity [0]. We now determine the addition 
table for the semigroup Z, with operation @. 
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o] f PB 


fo} fF ) BI 
f} 2! £2) 
2] Bl fo) 
B) ©} ff) 


The entries in this table are obtained from 
[a] @ [6] = [a +b}. 
Thus 
(1] ® [2] = (1 + 2] = [3) 
(1] ® [3] = [1 + 3] = [4] = [0] 
(2] © [3] = (2 + 3] = (5) = (J 
[3] ® [3] = [3 + 3] = [6] = [2]. 
It can be shown that Z,, has the n equivalence classes 


(0), (1). (2), --.. [a ~ 1) 


and that 
[a] @ [6] = fr]. 
where r is the remainder when a + b is divided by n. Thus, if n is 6, 
[2] @ 3] = [5] 
[3] © 5] = 2] 
[3] ® [3] = [0]. ° 
We shall now examine the connection between the structure of asemigroup 


(S, *) and the quotient semigroup (S/R, @), where R is a congruence relation on 
(S, *). 


Theorem 3. Let R be a congruence relation on a semigroup (S, *), and let 
(S/R, @) be the corresponding quotient semigroup. Then the function f, :S > S/R 
defined by 
f(a) = [a] 
is an onto homomorphism, called the natural homomorphism. 
Proof: If [a] & S/R, then fp(a) = [a], so fp is an onto function. Moreover, 
if a and b are elements of S, then 
Jp(a * b) = [a* B] 
= [a] @ [5] 
= fx(@) @ fal). 
SO fp is a homomorphism. oa 


Theorem 4 (Fundamental Homomorphism Theorem). Let f : S > T be a 
homomorphism of the semigroup (S, *) onto the semigroup (T, +’). Let R be the 
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relation on S defined by a R b jf and only if f(a) = f(b), for a and b in S. Then 
(a) R is a congruence relation. 
(b) (T, *’) and the quotient semigroup (S/R, @) are isomorphic. 


Proof: (a) We show that 8 is an equivalence relation. First, a R a for every 
a€5S,since f(a) = f(a). Next, if a R b, then f(a) = f(b), so b R a. Finally, if 
aRbandb Rc, thenf(a) = f(b) and f(b) = f(c), so f(a) = f(c) anda Rc. 
Hence R is an equivalence relation. Now suppose that a R a, and b R b,. 
Then 


f(@=fl@) and f(b) =f). 
Multiplying in T, we obtain 
F(a) * f(b) = flay) * f(b). 
Since f is a homomorphism, this last equation can be rewritten as 
Fla * b) = fla, * by). 
Hence 
(a* b) R (a, * by) 


and R is a congruence relation. : 
(b) We now consider the relation f from S/R to T defined as follows: 


f= (al, f@) | [a] € S/R}. 


We first show that f is a function. Suppose that [a] = [a’]. Then a R a’, so 
f(a) = f(a’), which implies that f is a function. We may now write 
f:SIR — T, where f ({a]) = f(a) for [a] © S/R. 

We next show thatf is one to one. Suppose that f([a]) = f({a’]). Then 


f(a) = f@). 


So a Ra’, which implies that [a] = [a’]. Hence f is one to one. 
Now we show that f is onto. Suppose that b € T. Since f is onto, 
f(a) = 5 for some element a in S. Then 


f({a]) = f(@) = b. 


So f is onto. 
Finally, 
fila| ® [b}) =f (a * 6) 
= f(a* b) = f(a) * fb) 
=f(la)) «fF (>). 
Hence f is an isomorphism. Sd 


Example 6. Let A = {0, 1}, and consider the free semigroup A* generated by A 
under the operation of catenation. Note that A* is a monoid with the empty 
string A as its identity. Let N be the set of all nonnegative integers. Then N is a 
semigroup under the operation of ordinary addition, denoted by (N, +). The 
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function f: A* — N defined by 
f(a) = the number of 1’s in a 
is readily checked to be a homomorphism. Let R be the following relation on A*: 
aRB ifandonlyif f(a) =f(p). 


That is, a R B if and only if @ and B have the same number of 1’s. Theorem 4 
implies that A*/R ~ N under the isomorphism f : A*/R > N defined by 


f({a}) = f(a) = the number of 1’s in a. rs 


Theorem 4(b) can be described by the diagram shown in Figure 9.2. Here fr 
is the natural homomorphism. It follows from the definitions of f, and f that 


Piaf 


Fr f 


S/R 
Figure 9.2 


since 


(Feta) =F@) 
= Ala) = Fla). 


EXERCISE SET 9.3 


1. 


Let (S, *) and (T, *’) be commutative semi- 4. Let (S, +) and (7, *’) be semigroups. Show that 
groups. Show that S X 7 (see Theorem 1) is S X Tand T X S are isomorphic semigroups. 
also a commutative semigroup. 


. Let (S, ) and (T, *’) be monoids. Show that In Exercises 5 through 14, determine whether the 
S X Tis also a monoid. Show that the identity relation R on the semigroup S is a congruence 
of S X Tis (es, e7). relation. 

Let (S, «) and (7, +’) be semigroups. Show that §. S = Z under the operation of ordinary addition; 

the function f: S X T > S defined by a R bif and only if 2 does not divide a — b. 
fG,)=s 

is a homomorphism of the semigroup S X T 6. S = Z under the operation of ordinary addi- 


onto the semigroup S. tion; a R b if and only if a + b is even. 
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10. 


11. 


12. 


13. 


14, 


7 


16. 


¢ 


17 
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S = any semigroup; a R b if and only if a = b. 


S = the set of all rational numbers under the 
operation of addition; a/b R c/d if and only if 
ad = be. 


. S = the set of all rational numbers under the 


operation of multiplication; a/b R c/d if and 
only if ad = bc. 


S = Z under the operation of ordinary addi- 
tion; a R b if and only if a = b (mod 3). 


S = Z under the operation of ordinary addi- 
tion; a R b if and only if a and 5 are both even 
or a and b are both odd. 


S = Z* under the operation of ordinary multi- 
plication; a R b if and only if |a — b| = 2. 


A = {0,1} and S = A*, the free semigroup gener- 
ated by A under the operation of catenation; 

a R Bif and only if a and B both have an even 
number of 1’s or both have an odd number of 1’s. 


S = {0,1} under the operation « defined by the 
table 


« [0 1 

0|0 1 

1{/1 0 

aR b if and only if a * a = b « b. (Hint: 
Observe that if x is any element in S, then 
x*xx=0,) 


Show that the intersection of two congruence 
relations on a semigroup is a congruence rela- 
tion. 


Show that the composition of two congruence 
relations on a semigroup need not be a congru- 
ence relation. 


Describe the quotient semigroup for S and R 
given in Exercise 9. 


18. 


19 


Consider the semigroup S = {a, b,c, d} with the 
following operation table. 


Consider the congruence relation R = {(a, a), 
(a, b), (b, a), (0, 8), (c,¢), (¢, d), (d,€), (d, )) 
on S. 
(a) Write the operation table of the quotient 
semigroup S/R. 
(b) Describe the natural homomorphism 
tpi 5S SIR. 


Consider the monoid S$ = {e, a, b, c} with the 
following operation table. 


Consider the congruence relation R = {(e,e), 
(e,4), (a, €), (a, a), (b, b), (b,c), (¢,5), (¢,c)} on S. 
(a) Write the operation table of the quotient 
monoid S/R. 
(b) Describe the natural homomorphism 
fri S > SIR. 


. Let A = {0,1} and consider the free semigroup 


A* generated by A under the operation of cate- 
nation. Let N be the semigroup of all nonnega- 
tive integers under the operation of ordinary 
addition. 

(a) Verify that the function f : A* > N, defined 
by f(a) = the number of digits in a, is a 
homomorphism. 

(b) Let R be the following relation on A*: 
aR Bif and only if f(a) = f(B). Show that 
R is a congruence relation on A*. 

(c) Show that A*/R and N are isomorphic. 


9.4. Groups 
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In this section we examine a special type of monoid, called a group, that has 
applications in every area where symmetry occurs. Applications of groups can be 
found in mathematics, physics, and chemistry, as well as in less obvious areas such 
as sociology. Recent and exciting applications of group theory have arisen in 
fields such as particle physics and in the solutions of puzzles such as Rubik’s cube. 
In this book, we shall present an important application of group theory to binary 
codes in Section 11.2. 

A group (G, *) is a monoid, with identity e, that has the additional prop- 
erty that for every element a © G there exists an element a © G such that 
a*a’ =a’ *a = e.Thusa group is a set G together with a binary operation * on 
G such that 


1. (a@* b) *c = a* (b * ) for any elements a, b, and cin G. 
2. There is a unique element e in G such that 
ate=erta for any a € G. 
3. For every a € G, there is an element a’ € G, called an inverse of a, 
such that 
axa =a ea=e. 


Observe that if (G, *) is a group, then + is a binary operation, so G must be 
closed under *; that is, 


axbEG for any elements a and 5 in G. 


To simplify our notation, from now on when only one group (G, *) is under 
consideration and there is no possibility of confusion we shall write the product 
a * b of the elements a and b in the group (G, *) simply as ab, and we shall also 
refer to (G, *) simply as G. 

A group G is said to be Abelian if ab = ba for all elements a and b in G. 


Example 1. The set of all integers Z with the operation of ordinary addition is 
an Abelian group. If a € Z, then an inverse of a is its negative —a. . 


Example 2. The set Z* under the operation of ordinary multiplication is not a 
group since the element 2 in Z* has no inverse. However, this set together with 
the given operation is a monoid. o 


Example 3. The set of all nonzero real numbers under the operation of ordi- 
nary multiplication is a group. An inverse of a # 0 is I/a. ¢ 
Example 4. Let G be the set of all nonzero real numbers and let 


ab 
i ea 


Show that (G, *) is an Abelian group. 
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Solution: We first verify that * is a binary operation. If a and b are ele- 
ments of G, then ab/2 is a nonzero real number and hence is in G. We next 
verify associativity. Since 


(arbyre=(P]nc~ 


and since 


ax(b*c)=a* (5 7 “ee if (eb)e 


the operation * is associative. 


The number 2 is the identity in G, for if a € G, then 


Gs OO) 4 =O 94,4 


Finally, if a € G, then a’ =: 4/a is an inverse of a, since 


pty OO 25 GO) 24 
a 2 2 


A= a * a. 
Since a + b = b * a for all a and b in G, we conclude that G is an Abelian 
group. ¢ 


Before proceeding with additional examples of groups, we develop several 
important properties that are sat.sfied in any group G. 


Theorem 1. Let G be a group. Fach element a in G has only one inverse in G. 


Proof: Let a’ and a” be inverses of a. Then 
a(aa”) = ae =a’ 


and 


Hence, by associativity, 
a =a". e 


From now on we shall denote the inverse of a by a™'. Thus in a group G we 
have 
ac =a a=e. 


Theorem 2. Let G be a group and let a, b, and c be elements of G. Then 
(a) ab = ac implies that b =: c (left cancellation property). 
(b) ba = ca implies that b = c (right cancellation property). 
Proof: (a) Suppose that 


ab = ac. 


Sec. 9.4 | Groups 351 


Multiplying both sides of this equation by a”! on the left, we obtain 


a™‘(ab) = a“'(ac) 
(a‘a)b = (a‘a)c _ by associativity 


eb = ec by the definition of an inverse 
b=c by definition of an identity 
(b) The proof is similar to that of part (a). 


Theorem 3. Let G be a group and let a and b be elements of G. Then 
(a) (a")71 =a. 
(b) (ab)! = bla! 
1 


Proof: (a) We show that a acts as an inverse for a™": 
aa'=aa=e. 


Since the inverse of an element is unique, we conclude that (a“')"! = a. 
(b) We easily verify that 


(ab)(b"'a7') = a(b(b"'a™)) = a((bb“a“!) = afea™') = aa =e 
and, similarly, 
(b-'a"')(ab) =e, 
so 
(ab) = boa, o 
Theorem 4. Let G be a group, and let a and b be elements of G. Then 


(a) The equation ax = b has a unique solution in G. 
(b) The equation ya = b has a unique solution in G. 


Proof: (a) The element x = a” ‘b is a solution of the equation ax = b, since 
a(a”'b) = (aa™')b = eb = b. 
Suppose now that x, and x, are two solutions of the equation ax = b. Then 


ax,=b and ax, =b. 


Hence 
aX, = aX. 
Theorem 2 implies that x, = x. 
(b) The proof is similar to that of part (a). 5 


From our discussion of monoids, we know that if a group G has a finite 
number of elements, then its binary operation can be given by a table, which is 
generally called a multiplication table. The multiplication table of a group G = 
{a,,@,...,@,} under the binary operation * must satisfy the following properties: 


1. The row labeled by e must contain the elements 


Ay, Q,-..,4, 
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and the column labelec. by e must contain the elements 
cal 
a 
a, 
2. From Theorem 4, it folicws that each element 5 of the group must appear 
exactly once in each row and column of the table. Thus each row and col- 


umn is a permutation of the elements a, a,....a, of G, and each row 
(and each column) determines a different permutation. 


If Gis a group that has a finite number of elements, we say that G is a finite 
group, and the order of G is the number of elements | G| in G. We shall now deter- 
mine the multiplication tables of all nonisomorphic groups of orders 1,2,3, and 4. 

If G is a group of order 1, then G = {e}, and we have ee = e. Now let G = 
{e, a} be a group of order 2. Then we obtain a multiplication table (Table 9.1) 
where we need to fill in the blank. 


Table 9.1 
é€ a 
€ e a 
a a 


The blank can be filled in by e or by a. Since there can be no repeats in any row 
or column, we must write e in the blank. The multiplication table shown in Table 
9.2 satisfies the associative property and the other properties of a group, so it is 
the multiplication table of a group of order 2. 


Table 9.2 
e a 
- é a 
4 a e 


Next, let G = {e, a, b} be a group of order 3. We have a multiplication table 
(Table 9.3) where we must fill in four blanks. 


Table 9.3 Table 9.4 
e a b e a 
e e a b e € 


re 
anor, so 
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A little experimentation shows that we can only complete the table as shown in 
Table 9.4. It can be shown (a tedious task) that Table 9.4 satisfies the associative 
property and the other properties of a group. Thus it is the multiplication table of 
a group of order 3. Observe that the groups of orders 1, 2, and 3 are also Abelian 
and that there is just one group of each order for a fixed labeling of the elements. 

We next come to a group G = {e, a, b, c} of order 4. It is not difficult to show 
that the possible multiplication table for G can be completed as shown in Tables 
9.5 through 9.8, It can be shown that each of these tables satisfies the associative 
property and the other properties of a group. Thus there are four possible multi- 
plication tables for a group of order 4. Again, observe that a group of order 4 is 
Abelian. We shall return to groups of order 4 toward the end of this section, 
where we shall see that there are only two and not four different nonisomorphic 
groups of order 4. 


Table 9.5 Table 9.6 
e a b c 
e e a b c 
a a e c b 
b b c a e 
c c b e a 
Table 9.7 Table 9.8 
e a b c e a b c 
b 5 
c e 
e c 
a a 


Example 5. Let B = {0,1}, and let + be the operation defined on B as follows: 
+/0 1 
0;0 1 
1/1 0 

Then B is a group. In this group, every element is its own inverse. Sd 


We next tur to an important example of a group. 


Example 6. Consider the equilateral triangle shown in Figure 9.3 with vertices 
1, 2, and 3. A symmetry of the triangle (or of any geometrical figure) is a one-to- 
one correspondence from the set of points forming the triangle (the geometrical 
figure) to itself that preserves the distance between adjacent points. Since the tri- 
angle is determined by its vertices, a symmetry of the triangle is merely a permu- 
tation of the vertices that preserves the distance between adjacent points. Let /,, 
L,, and J, be the angle bisectors of the corresponding angles as shown in Figure 
9.3, and let O be their point of intersection. 
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3 
i i 
/ 
£ ; 
1 l, 2 
Figure 9.3 


We now describe the symmetries of this triangle. First, there is a counterclockwise 
rotation f, of the triangle abou: O through 120°. Then f, can be written (see 
Section 5.3) as the permutation 


ae ee 
n=(; 3 i 


We next obtain a counterclockwise rotation f,; about O through 240°, which can 
be written as the permutation 


Finally, there is a counterclockwise rotation f, about O through 360°, which can 
be written as the permutation 

pe fi 2 3 

ro 2 3/ 


Of course, f, can also be viewed as the result of rotating the triangle about O 
through 0°. 

We may also obtain three additional symmetries of the triangle, g,, g,, and 
g;, by reflecting about the lines /,, 1, and /,, respectively. We may denote these 
reflections as the following permutations: 


_fi1 23 _ft 23 _(l 23 
“\1 3 2h 8&7 \3 2 ip) 8 lo 1 3h 


Observe that the set of all symmetries of the triangle is described by the set 
of permutations of the set {1, 2, 3}, which has been considered in Section 5.3 and 
is denoted by S,. Thus 


5; = {fis fos fa 81> 82» 83): 


We now introduce the operation +, followed by, on the set S,, and we obtain 
the multiplication table shown in Table 9.9. 
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Table 9.9 


Each of the entries in this table can be obtained in one of two ways: algebraically 
or geometrically. For example, suppose that we want to compute f; * g). 
Proceeding algebraically, we have 


1 2 3) fl 2 3\ {1 2 3\_ 

ae aes ie ee oe a Oe ed 
Geometrically, we proceed as in Figure 9.4. Since composition of functions is 
always associative, we see that * is an associative operation on S;. Observe that f, 
is the identity in S, and that every element of S, has a unique inverse in S,. For 
example, f; ' = f,. Hence S; is a group called the group of symmetries of the tri- 


angle. Observe that S; is the first example that we have given of a group that is 
not Abelian. 


L, 2 3 l, 1 1 l, 3 
Given triangle Triangle resulting after Triangle resulting after applying 
applying fy g, to the triangle at the left 
Figure 9.4 


Example 7. The set of all permutations of n elements is a group of order n! 
under the operation of composition. This group is called the symmetric group on 
n letters and is denoted by S,. We have seen that S, also represents the group of 
symmetries of the equilateral triangle. Sd 


As in Example 6, we can also consider the group of symmetries of a square. 
However, it turns out that this group is of order 8, so it does not agree with the 
group S,, whose order is 4! = 24. 
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Example 8. In Section 9.3 we discussed the monoid Z,,. We now show that Z, is 
a group as follows. Let [a] € Z,,. Then we may assume that 0 < a < n. Moreover, 
[n — a] & Z,, and since 


[a] © [nw ~ a] = [a + n— a} = [n] = [0], 


we conclude that [n — a] is the inverse of [a]. Thus, if 1 is 6, then [2] is the inverse 
of [4]. Observe that Z,, is an Abelian group. Sa 


We next turn to a discussion of important subsets of a group. Let H be a 
subset of a group G such that 


(a) The identity e of G belongs to H. 
(b) If a and b belong to H, then ab € H. 
(c) Ifa € H,thena'€ 4. 


Then H is called a subgroup of G. Part (b) says that H is a subsemigroup of G. 
Thus a subgroup of G can be viewed as a subsemigroup having properties (a) and 
(c). 

Observe that if G is a group and H is a subgroup of G, then H is also a 
group with respect to the operation in G, since the associative property in G also 
holds in H. 


Example 9. Let G be a group. Then G and H = {e} are subgroups of G, called 
the trivial subgroups of G. Sd 


Example 10. Consider S;, the group of symmetries of the equilateral triangle, 
whose multiplication table is shown in Table 9.9. It is easy to verify that H = 
(f1.f fs} is a subgroup of S;, + 


Example 11. Let A, be the se: of all even permutations (see Section 5.3) in the 
group S,. It can be shown from the definition of even permutation that A, is a 
subgroup of §,, called the alternating group on 7 letters. Sd 


Example 12. Let G be a group and let a © G. Since a group is a monoid, we 
have already defined, in Section 9.2, a” for n € Z* as aa --- a (n factors), and a° 
as e.If nis a negative integer, we now define a” as a 'a™! ---a~' (n factors). Then, 


ifn and m are any integers, we rave 


It is easy to show that 
iT = {a {ie Z| 
is a subgroup of G. Sd 
Let (G, +) and (G’, +’) be two groups. Since groups are also semigroups, we 
can consider isomorphisms and homomorphisms from (G, *) to (G’, #’). 


Since an isomorphism must be a one-to-one and onto function, it follows 
that two groups whose orders are unequal cannot possibly be isomorphic. 
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Example 13. Let G be the group of real numbers under addition, and let G’ be 
the group of positive real numbers under multiplication. Let f: G > G’ be 
defined by f(x) = e*. We now show that f is an isomorphism. 

If f(a) = f(b), so that e* = e°, then a = b. Thus f is one to one. If c € G’, 
then In c € G and 


f(Inc) =e" =, 
so f is onto. Finally, 
f(a + b) = 8? = eve? = f(a) f(b). 

Hence f is an isomorphism. e 
Example 14. Let G be the symmetric group of x letters, and let G’ be the group 
B defined in Example 5. Let f: G > G’ be defined as follows: for p € G, 

0 ifp€A, (the subgroup of all even permutations in G) 

ip) = 
1 if p € A,,. 


Then f is a homomorphism. Sd 


Example 15. Let G be the group of integers under addition, and let G’ be the 
group Z,, as discussed in Example 8. Let f : G — G’ be defined as follows: If 
m & G, then f(m) = (r], where r is the remainder when m is divided by n. We now 
show that fis a homomorphism of G onto G’. 

Let [r] © Z,. Then we may assume that 0 =r <n,so 


r=O-:n+yr, 
which means that the remainder when r is divided by n is r. Hence 
FQ) = (] 


and thus f is onto. 
Next, let a and b be elements of G expressed as 


a=qnt+n, where 0 = 7, < », and 7, and q, are integers (1) 
b=qntn, where 0 = 7, <n, and r, and q, are integers (2) 
so that 
f(a) = [rn] and f(6) = [ro]. 
Then 


fla) + f(b) = In) + In} = In + 1) 
To find [r, + r,], we need the remainder when 7, + 7; is divided by n. Write 
rth=aqgnt rs, where 0 = r, < n, andr, and q, are integers. 
Thus 
f(a) + f(b) = [rs]. 
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Adding, we have 
at+b=qntqntnAtn 
=(A+antaqgantr, 
so 
flat 6) = |r, +7] = [rn]. 
Hence 
f(a + 6) = f@ + f), 


which implies that f is a homomorphism. 
When n is 2, f assigns each even integer to [0] and each odd integer to [1]. 
o 


Theorem 5. Let (G, *) and (G’, +’) be two groups, and let f: G > G’ be a homo- 
morphism from G to G’. 

(a) If e is the identity in G and e’ is the identity in G’, then f(e) = e’. 

(b) If a & G, then f(a’) =: (f(a). 

(c) If H is a subgroup of G, then 

fF) = {f) |h © H} 
is a subgroup of G’. 
Proof: (a) Let x = f(e). Then 
x#'x = fle) * fle) = fle +e) = fle) = x, 

so x *’ x = x. Multiplying both sides by x! on the right, we obtain 

1 , 


xexe ye’ x b=xe’ x pe 
Thus f(e) = e’. 
(b) ata =e, 
so 
f(a*a) = fle) =e’ by part (a) 
or 


f(a) * f(a) =e’ since f is a homomorphism. 
Similarly, 
fa") ¥ f@ =e’. 


Hence f(a‘) = (f(a))"'. 
(c) This follows from Theorem 4 of Section 9.2 and parts (a) and (b). 


Example 16. The groups S, and Z, are both of order 6. However, S, is not 

Abelian and Z, is Abelian. Hence they are not isomorphic. Remember that an 

isomorphism preserves all properties defined in terms of the group operations. 
Sd 
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Example 17. Earlier in this section we found four possible multiplication tables 
(Tables 9.5 through 9.8) for a group of order 4. We now show that the groups with 
multiplication Tables 9.6, 9.7, and 9.8 are isomorphic as follows. Let G = {e, a,b,c} 
be the group whose multiplication table is Table 9.6, and let G’ = {e’, a’, b’,c’} be 
the group whose multiplication table is Table 9.7, where we put primes on every 
entry in this last table. Let f: G — G’ be defined by f(e) = e’, f(a) = b’, 
f(b) = a’, f(c) = c’. We can then verify that under this renaming of elements the 
two tables become identical, so the corresponding groups are isomorphic. 
Similarly, let G” = {e”, a”, b”, c’”} be the group whose multiplication table is 
Table 9.8, where we put double primes on every entry in this last table. Let 
g:G— G” be defined by g(e) = e”, g(a) = c”, g(b) = b”, g(c) = a”. We can then 
verify that under this renaming of elements the two tables become identical, so 
the corresponding groups are isomorphic. That is, the groups given by Tables 9.6, 
9.7, and 9.8 are isomorphic. 

Now, how can we be sure that Tables 9.5 and 9.6 do not yield isomorphic 
groups? Observe that if x is any element in the group determined by Table 9.5, 
then x? = e. If the groups were isomorphic, then the group determined by Table 
9.6 would have the same property. Since it does not, we conclude that these 
groups are not isomorphic. Thus there are exactly two nonisomorphic groups of 
order 4. 

The group with multiplication Table 9.5 is called the Klein 4 group and it is 
denoted by V. The one with multiplication Table 9.6, 9.7, or 9.8 is denoted by Z,, 
since a relabeling of the elements of Z, results in this multiplication table. a 


EXERCISE SET 9.4 


In Exercises 1 through 11, determine whether the 8. The real numbers that are not equal to —1, 


set together with the binary operation is a group. 


whereaxb=a+bh+ ab 


If it is a group, determine if it is Abelian, specify 


the identity and the inverse of an element a. 


1. Z, where + is ordinary multiplication 
2. Z, where * is subtraction 


3. Q, the set of all rational numbers under the 
operation of addition 


4. Q, the set of all rational numbers under the 
operation of multiplication 


5. R, under the operation of multiplication 
6. R, whereas b=at+b+2 


7. Z*, under the operation of addition 


10. 


11. 


MO= p> Ae=1-5 hey 


. The set of odd integers under the operation of 


multiplication 


The set of all m x n matrices under the opera- 
tion of matrix addition 


If S is a nonempty set, the set P(S), where 
Ax B=A@B (See Section 1.2.) 


Let S = {x|x is a real number and x # 0, 
x # —1}. Consider the following functions 
fi S>S,i=1,2,...,6: 


AW=x fW=l-x f=2 
x 
x-1 
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13. 


14 


15. 


16. 


17. 


18, 


? 


19. 
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Show that G = (fi, fa, fas fas fs fol 18 a group 
under the operation of composition. Give the 
multiplication table of G. 


Let G be a group with identity e. Show that if 
x? = x for some x in G, then x = e. 


Show that a group G is Abelian if and only if 
(aby’ = ab’ for all elements a and 6 in G. 


Let G be the group defined in Example 4. Solve 
the following equations: (a) 3 « x = 4; 
(b) y*5 = —2. 


Let G be a group with identity e. Show that if 
@ = ¢ forall ain G, then G is Abelian. 


Consider the square shown in Figure 9.5. The 
symmetries of the square are 


4 3 
1 2 
Figure 9.5 


Rotations f,, f,, f;, and f, through 0°, 90°, 180°, 
and 270°, respectively. 

f; and f,, reflections about the lines v and A, 
respectively. 

f,and fy, reflections about the diagonals d, and 
d,, respectively. 


Write the multiplication table of D,, the group 
of symmetries of the square. 


Let G be a group. Show by mathematical induc- 
tion that if ab = ba, then (ab)" = a"b" for n € Z*. 


Let G be a finite group with identity e, and let a 
be an arbitrary element of G. Prove that there 
exists a nonnegative integer n such that a” = e. 


20. 


21 


22. 


26. 


27. 


28. 


30. 


Let G be the group of integers under the oper- 
ation of addition. Which of the following sub- 
sets of G are subgroups of G? (a) the set of all 
even integers; (b) the set of all odd integers. 


Is the set of positive rationals a subgroup of the 
group of real numbers under the operation of 
addition? 


Let G be the nonzero integers under the opera- 
tion of multiplication, and let H = {3"|n € Z}. 
Is H a subgroup of G? 


Let G be the group of integers under the opera- 
tion of addition, and let H = (3k|k € Z).IsHa 
subgroup of G? 


Let G be an Abelian group with identity e, and 
let H = {x |x? = e}. Show that His a subgroup 
of G. 


. Let G be a group, and let H = {x |x € G and 


xy = yx for all y © G}. Prove that H is a sub- 
group of G. 


Let G be a group and let a € G. Define H, = 
{x |x © G and xa = ax}. Prove that H, is a 
subgroup of G. 


Let A, be the set of all even permutations in S,,. 
Show that A,, is a subgroup of S,,. 


Let H and K be subgroups of a group G. 

(a) Prove that HM K is a subgroup of G. 

(b) Show that H U K need not be a subgroup 
of G. 


29. Find all subgroups of the group given in 


Exercise 17. 


Let G be an Abelian group and n a fixed inte- 
ger. Prove that the function f: G — G defined 
by f(a) = a", for a € G, is a homomorphism. 


. Prove that the function f(x) = |x| is a homo- 


morphism from the group G of nonzero real 
numbers under multiplication to the group G’ 
of positive real numbers under multiplication. 


32. 


33. 


34. 


35. 


Let G be a group with identity e. Show that the 
function f : G > G defined by f(a) = e for all 
a € Gis a homomorphism. 


Let G be a group. Show that the function 
f:G— G defined by f(a) = a’ is a homomor- 
phism if and only if G is Abelian. 


Show that the group in Exercise 12 is isomor- 
phic to S;. 


Show that if f: G — G’ is an isomorphism, then 
f~':G’ > Gis also an isomorphism. 


. Let S be the set of all finite groups and define 


the following relation R on S:G RG’ if and 
only if G and G’ are isomorphic. Prove that R 
is an equivalence relation. (Hint: Use Exercise 
35.) 


Sec. 


37. 


38. 


39. 


40. 


9.5. Products and Quotients of Groups 


9.5 Products and Quotients of Groups 361 


Let G be the group of integers under the oper- 
ation of addition, and let G’ be the group of all 
even integers under the operation of addition. 
Show that the function f: G > G’ defined by 
f(a) = 2a is an isomorphism. 


Let G be a group. Show that the function 
f:G > G defined by f(a) = a” is an isomor- 
phism if and only if G is Abelian. 


Let G be a group and let a be a fixed element 
of G. Show that the function f, : G > G defined 
by f,(x) = axa“, for x € G, is an isomorphism. 


Let G = {e,a, aa’, a‘,a°} be a group under the 
operation of a'a/ = a’, where i + j =r (mod 6). 
Prove that G and Z, are isomorphic. 


In this section, we shall obtain new groups from other groups by using the ideas 
of product and quotient. Since a group has more structure than a semigroup, our 
results will be deeper than the analogous results for semigroups as discussed in 
Section 9.3. 


Theorem 1. If G, and G, are groups, then G = G, X G, is a group with opera- 
tion defined by 


(4, Dy) (az, bz) = (aya, by). + 


Example 1. Let G, and G, be the group Z,. For simplicity of notation, we shall 


write the elements of Z, as 0 and 1, respectively, instead of [0] and [1]. Then the 
multiplication table of G = G, X G, is given in Table 9.10. 


Table 9.10 Multiplication Table of Z, x Z, 


Since G is a group of order 4, it must be isomorphic to V or to Z, (see 
Section 9.4), the only groups of order 4. By looking at the multiplication tables, 
we see that the function f: V > Z, X Z, defined by f(e) = (0, 0), f(a) = G, 0), 
f(b) = (0, 1), and f(c) = (1, 1) is an isomorphism. Sd 
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If we repeat Example |. with Z, and Z,, we find that Z, x Z, ~ Z,. It can be 
shown, in general, that Z,, X Z, = Z,,, if and only if GCD(m, n) = 1, that is, if 
and only if m and v are relatively prime. 

Theorem | can obviously be extended to show that if G,, G,,..., G, are 
groups, then G = G, X G, X --: X G, is also a group. 


Example 2. Let B = {0, 1} be the group defined in Example 5 of Section 9.4, 
where + is defined as follows: 


Re o];+ 


0.1 
01 
1 0 


Then B" = B X B X.--- X B (n factors) is a group with operation @ defined by 


(ys X25 06+ Hy) D Mt Vase Vn) = Hy $ Vy Xz H Vay 0+ Hy + In): 


The identity of B” is (0,0,...,0), and every element is its own inverse. This group 
is essentially the same as the Boolean algebra B, defined in Section 7.4, but the 
binary operation is very different from /\ and V. ° 


A congruence relation on a group is simply a congruence relation on the 
group when it is viewed as a semigroup. We now discuss quotient structures 
determined by a congruence relation on a group. 


Theorem 2. Let R be a congruence relation on the group (G, *). Then the semi- 
group (G/R, ®) is a group, where the operation @ is defined on G/R by 


[a] ®[b] = [a*b] (see Section 9.3). 


Proof: Since a group is a monoid, we know from Corollary 1 of Section 9.3 
that G/R is a monoid. We need to show that each element of G/R has an 
inverse. Let [a] € G/R. Then [a~"] € G/R, and 


[a] ® [a~*] = [a +a") = [e]. 
So [a]~' = [a7']. Hence (G/R, ®) is a group. Sa 


Since the definitions of hornomorphism, isomorphism, and congruence for 
groups involve only the semigroup and monoid structure of groups, the following 
corollary is an immediate consequence of Theorems 3 and 4 of Section 9.3. 


Corollary 1 
(a) If R is a congruence relation on a group G, then the function 
fa: G > GIR, given by &(a) = [a], is a group homomorphism. 
(b) If f: G— G’ is a homomorphism from the group (G, *) onto the group 
(G’, *’), and R is the relation defined on G by a R b if and only if 
f(a) = f(b), for a and b in G, then 


1. R is a congruence relation. 
2. The function f : GIR — G’, given byf ([a]) = f(a), is an isomorphism 
from the group (G/F, ®) onto the group (G’, *’). ° 
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Congruence relations on groups have a very special form, which we will 
now develop. Let H be a subgroup of a group G, and let a € G. The left coset of 
H in G determined by a is the set aH = {ah | h € H}. The right coset of H in G 
determined by a is the set Ha = {ha|h € H}. Finally, we will say that a subgroup 
HA of Gis normal if aH = Ha for alla in G. 


WARNING. If Ha = aH, it does not follow that, for h © H and a € G, ha = ah. It 
does follow that ha = ah’, where h’ is some element in H. 


If His a subgroup of G, we shall need to compute all the left cosets of H in 
G. First, suppose that a € H. Then aH C H, since H is a subgroup of G; moreover, 
ifh © H, then h = ah’, where h’ = a™'h € H, 80 that H C aH. Thus, if a € H, then 
aH = H. This means that, when finding all the cosets of H, we need not compute 
aH for a € H, since it will always be H. 


Example 3. Let Gbe the symmetric group S, discussed in Example 6 of Section 
9.4. The subset H = {f,, g,} isa subgroup of G. Compute all the distinct left cosets 
of Hin G. 


Solution: Ifa € H,then aH = H. Thus 


fH = go = H. 
Also, 
fH = (hy 8} 
SH = {fos 85} 
gH = (gf) =f 
83H = (ga, fa} = fH. 
The distinct left cosets of H in G are H, f,H, and f,H. 


Example 4. Let Gand H be as in Example 3. Then the right coset Hf, = {f5, g3}. 
In Example 3 we saw that f,H = {f,, g,}. It follows that H is not a normal sub- 
group of G. Sd 


Example 5. Show that if G is an Abelian group, then every subgroup of G is a 
normal subgroup. 


Solution: Let H be a subgroup of G and let a © G andh ©& H. Then 
ha = ah,so Ha = aH, which implies that H is a normal subgroup of G. 


Theorem 3. Let R be a congruence relation on a group G, and let H = [el], the 
equivalence class containing the identity. Then H is a normal subgroup of G and, 
for each a © G, [a] = aH = Ha. 


Proof: Leta and b be any elements in G. Since R is an equivalence rela- 
tion, b € [a] if and only if [b] = [a]. Also, G/R is a group by Theorem 2. 
Therefore, [b] = [a] if and only if [e] = [a]~'[b] = [a7*b]. Thus b & [a] if and 
only if H = [e] = [a~‘b]. That is, b & [a] if and only if a-'b € H or b € a. 
This proves that [a] = aH for every a € G. We can show similarly that 
b & [a] if and only if H = [e] = [b][a]~' = [ba™']. This is equivalent to the 
statement [a] = Ha. Thus [a] = aH = Ha, and His normal. Sa 
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Combining Theorem 3 with Corollary 1, we see that in this case the quotient 
group G/R consists of all the le‘t cosets of N = [e]. The operation in G/R is given 
by 

(aN)(bN) = [a] © [b] = [ab] = abN 


and the function fp : G > G/R, defined by fa(a) = aN, is a homomorphism from 
G onto G/R. For this reason, we will often write G/R as G/N. 

We next consider the ques-ion of whether every normal subgroup of a group 
G is the equivalence class of the identity of G for some congruence relation. 


Theorem 4. Let N be a normal subgroup of a group G,and let R be the follow- 
ing relation on G: 


aRb ifandonlyif a'bEN. 


Then 
(a) R is a congruence relation on G. 
(b) N is the equivalence class [e] relative to R, where e is the identity 
of G. 


Proof: (a) Let a € G. Then a R a, since a"'a = e E N, 580 R is reflexive. 
Next, suppose that a R b, so that a'b © N. Then (a'b)! = b''a EN, so 
b Ra. Hence R is symmettic. Finally, suppose that a R b and b R c. Then 
ab © Nand b“'c € N. Then (a'b)(b'c) = a'c € N,soa Rc. Hence R 
is transitive. Thus R is an equivalence relation on G. 

Next we show that R is a congruence relation on G. Suppose that a R b 
and c R d. Then a 'b € Nandc_'d € N. Since N is normal, Nd = dN; that 
is, for any n, © N,n,d = dv, for some n, € N. In particular, since a'b € N, 
we have a“'bd = dn, for some n, © N. Then (ac)'bd = (c™'a™!)(bd) = 
c'(a"'b)d = (c7'd)n, € N, so ac R bd. Hence R is a congruence relation 
on G. 

(b) Suppose that x € N. Then x"'e = x7! & N since N is a subgroup, so 
x Re and therefore x & [e|. Thus N C [e]. Conversely, if x € [e], then x Re, 
sox-'e = x"! © N.Then x & N and [e] C N. Hence N = fe]. A 


We see, thanks to Theorenis 3 and 4, that if G is any group, then the equiv- 
alence classes with respect to a coagruence relation on G are always the cosets of 
some normal subgroup of G. Conversely, the cosets of any normal subgroup of G 
are just the equivalence classes with respect to some congruence relation on G. 
We may now, therefore, translate: Corollary 1(b) as follows: Let f be a homomor- 
phism from a group (G, *) onto a group (G’, *’), and let the kernel of f, ker(/), 
be defined by 


ker(f) = {a € G| f(a) = e’}. 
Then 
(a) ker(f) is a normal subgroup of G. 
(b) The quotient group G/ker(f) is isomorphic to G’. 


This follows from Corollary 1 and Theorem 3, since if R is the congruence rela- 
tion on G given by 
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aRb ifandonlyif f(a) = f(b), 
then it is easy to show that ker(f) = [e]. 


Example 6. Consider the homomorphism f from Z onto Z,, defined by 


fm) = Ir), 


where r is the remainder when m is divided by n. (See Example 15 of Section 9.4.) 


Find ker(f). 
Solution: The integer m in Z belongs to ker(f) if and only if f(m) = [0], 
that is, if and only if m is a multiple of n. Hence ker(f) = nZ. * 


EXERCISE SET 9.5 


1. 


N 


a 


8. 


Write the multiplication table of the group 
ZX Zy. 


Prove that if G and G’ are Abelian groups, then 
G X G’ is an Abelian group. 


Let G, and G, be groups. Prove that G, x G, 
and G, X G, are isomorphic. 


. Let G, and G, be groups. Show that the func- 


tion f: G, X G, > G, defined by f(a, b) = a, 
for a € G, and b € G,, is a homomorphism. 


. Determine the multiplication table of the quo- 


tient group Z/3Z, where Z has operation +. 


. Let Z be the group of integers under the opera- 


tion of addition. Prove that the function 
f:ZX Z— Z defined by f(a,b) =a+ bisa 
homomorphism. 


Let G = Z,, For each of the following sub- 
groups H of G, determine all the left cosets of 
HinG. 

(a) H = {[0}} (b) H = {[0}, (2]) 

(c) A = {(0}, (1), [2], BY} 


Let G = S;. For each of the following sub- 
groups H of G, determine all the left cosets of 
AinG. 

(a) H= (fi, 8) (b) H= {fi.83) 

(c) H= (fff (4) H = {fi} 

(e) H= {fifa fs Bu 82 8s) 


9. 


10. 


11. 


13. 


? 


14. 


Let G = Z,. For each of the following sub- 
groups H of G, determine all the left cosets of 
HinG. 

(a) 4 = {(0}, [4]} 

(b) A= ((0], (21. (41, (61) 


Let G be the group of all nonzero real numbers 
under the operation of multiplication, and con- 
sider the subgroup H = (3"|n & Z} of G. 
Determine all the left cosets of H in G. 


Let Z be the group of integers under the opera- 
tion of addition, and let G = Z x Z. Consider 
the subgroup H = {(x,y) |x = y} of G. Describe 
the left cosets of H in G. 


. Let N be a subgroup of a group G, and let 


a & G. Define 
a'Na = {a'na|n EN}. 


Prove that N is a normal subgroup of G if and 
only if a~'Na = N for alla € G. 


Let N be a subgroup of group G. Prove that 
N is anormal subgroup of G if and only if 
a'Na CN for alla € G. 


Find all the normal subgroups of 53. 


. Find all the normal subgroups of D,. (See 


Exercise 17 of Section 9.4.) 


366 


16. 


17. 


18. 


19. 


20. 


Chapter9 Semigroups and Groups 


Let G be a group, and let H = {x|x © Gand 
xa = ax for all a € G}. Show that H is a normal 
subgroup of G. 


Let H be a subgroup of a group G. Prove that 
every left coset aH of H has the same number of 
elements as H by showing that the function 
f,:H — aH defined by f,(4) = ah, for h € H, is 
one to one and onto. 


Let H and K be normal subgroups of G. Show 
that H M K is a normal subgroup of G. 


Let G be a group and H a subgroup of G. Let 
S be the set of all left cosets of H in G, and let 
T be the set of all right cosets of H in G. 
Prove that the function f: § — T defined by 
f(aH) = Ha‘ is one to one and onto. 


Let G, and G, be groups. Let f: G, X G, > G, 
be the homomorphism from G, X G, onto G, 
given by f((81, 82)) = 82 Compute ker( f). 


KEY IDEAS FOR REVIEW 


5 i dnd 


Binary operation on A: everywhere defined 
function f:A X A>A 

Commutative binary operation:a*b=b*a 
Associative binary operation: a * (b * c) = 
(a*b)*c 

Semigroup: nonempty set S together with an 
associative binary operation + defined on S$ 
Monoid: semigroup that has an identity 
Subsemigroup (7, *) of semigroup (S, *): Tis a 
nonempty subset of S and a * b € T whenever 
aand b are in T. 

Submonoid (7, *) of monoid (S, *): T is a non- 
empty subset of S,e € T, and a + b © T when- 
ever a and b are in T. 

Isomorphism: see page 337 

Homomorphism: see page 339 

Theorem: Let (S, *) and (T, *’) be monoids with 
identities e and e’, respectively, and suppose 
that f: S > Tis an isomorphism. Then f(e) = e’. 
Theorem: If (S, +) and (7, *’) are semigroups, 


21. Let f be a homomorphism from a group G, 
onto a group G,, and suppose that G, is 
Abelian. Show that ker(f) contains all ele- 
ments of G, of the form aba~'b™', where a and 
b are arbitrary in G,. 


22. Let G be an Abelian group and N a subgroup 
of G. Prove that G/N is an Abelian group. 


23. Let H be a subgroup of the finite group G and 
suppose that there are only two left cosets of H 
in G, Prove that H is a normal subgroup of G. 


24. Let H and N be subgroups of the group G. 
Prove that if N is a normal subgroup of G, then 
Hf Nisa normal subgroup of H. 


25. Let f: G— G’ be a group homomorphism. 
Prove that fis one to one if and only if 


ker(f) = (e). 


then (S < T, *”) is a semigroup, where *” is 
defined by 


(5154) *” (Sp, ) = (81 * Sp, ty * by), 


Congruence relation R on semigroup (5S, *): 
equivalence relation R such that a R a’ and 
5 Rb’ imply that (a * b) R (@’ * b’) 

Theorem: Let R be a congruence relation on 
the semigroup (S, *). Define the operation © in 
S/R as follows: 


[a] @ [b] = [a * b]. 


Then (S/R, ®) is a semigroup. 

Quotient semigroup or factor semigroup S/R: 
see page 344 

Z,. see page 344 

Theorem (Fundamental Homomorphism 
Theorem): Let f: 5 + Tbe a homomorphism of 
tie semigroup (S, *) onto the semigroup (T, *’). 
Let R be the relation on S defined by a R b if 


and only if f(a) = f(b), for a and b in S. Then 
(a) R is a congruence relation. 
(b) T is isomorphic to S/R. 

¢# Group (G, *): monoid with identity e such that 
for every a & G there exists a’ € G with the 
property thata +a’ =a’*a =e 

¢ Theorem: Let G be a group, and let a, b, and c 
be elements of G. Then 
(a) ab = ac implies that b = c (left cancellation 

property). 
(b) ba = ca implies that b = c (right cancella- 
tion property). 

# Theorem: Let G be a group, and let a and b be 
elements of G. Then 
(a) (a) "=a. 
(b) (ab) 1} = b'a7t, 

® Order of a group G :|G 
ments in G 

 S,: the symmetric group on n letters 

@ Subgroup: see page 356 

¢# Theorem: Let R be a congruence relation on 
the group (G, *). Then the semigroup (G/R, ®) 


, the number of ele- 


CODING EXERCISES 


For each of the following, write the requested pro- 
gram or subroutine in pseudocode (as described in 
Appendix A) or in a programming language that 
you know. Test your code either with a paper-and- 
pencil trace or with a computer run. 


Let Z,, be as defined in Section 9.3. 


1. Write a function SUM that takes two ele- 
ments of Z,,, [x] and [y], and returns their sum 
[x] @ [)]. The user should be able to input a 
choice for n. 


2. Let H = {[0], [2]}. Write a subroutine that 
computes the left cosets of H in Z,. 
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is a group, where the operation @ is defined in 
GIR by 


[a] ® [b] = [a 5]. 


Left coset aH of H in G determined by a: 
{ah |h © H} 
Normal subgroup: subgroup H such that 
aH = Ha forallainG 
Theorem: Let R be a congruence relation on a 
group G, and let H = [e], the equivalence class 
containing the identity. Then #7 is a normal sub- 
group of G and, for each a € G, [a] = aH = Ha. 
Theorem: Let N be a normal subgroup of a 
group G, and let R be the following relation on 
G: 

aRb ifandonlyif a'bEN. 
Then 
(a) R is a congruence relation on G. 


(b) N is the equivalence class [e] relative to R, 
where ¢ is the identity of G. 


. Let H = {[0], [2], [4], [6]}. Write a subroutine 


that computes the right cosets of H in Z,. 


. Write a program that, given a finite operation 


table, will determine if the operation satisfies 
the associative property. 


. Write a program that, given a finite group G 


and a subgroup H, determines if H is a nor- 
mal subgroup of G. 


CHAPTE 


Prerequisites: Chapters 8 and 9 


In this chapter we return to the study of formal languages and develop another 
mathematical structure, phrase structure grammars, a simple device for the con- 
struction of useful formal languages. We also examine several popular methods 
for representing these grammars. 

Next, we look at finite-state machines. A finite-state machine is a model 
that includes devices ranging from simple “flip-flops” to entire computers. It can 
also be used to describe the effect of certain computer programs and nonhard- 
ware systems. Finite-state machines are useful in the study of formal languages 
and are often found in compilers and interpreters for various programming lan- 
guages. There are several types and extensions of finite-state machines, but in this 
chapter we will introduce only the most elementary versions. 


10.1. Languages 


In Section 1.3, we considered the set $* consisting of all finite strings of elements 
368 from the set S$. There are manv possible interpretations of the elements of S*, 
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depending on the nature of S. If we think of S as a set of “words,” then S* may be 
regarded as the collection of all possible “sentences” formed from words in S, Of 
course, such “sentences” do not have to be meaningful or even sensibly con- 
structed. We may think of a language as a complete specification, at least in prin- 
ciple, of three things. First, there must be a set S consisting of all “words” that are 
to be regarded as being part of the language. Second, a subset of S* must be des- 
ignated as the set of “properly constructed sentences” in the language. The mean- 
ing of this term will depend very much on the language being constructed. 
Finally, it must be determined which of the properly constructed sentences have 
meaning and what the meaning is. 

Suppose, for example, that S consists of all English words. The specification 
of a properly constructed sentence involves the complete rules of English gram- 
mar; the meaning of a sentence is determined by this construction and by the 
meaning of the words. The sentence 


“Going to the store John George to sing” 


is a string in S*, but is not a properly constructed sentence. The arrangement of 
nouns and verb phrases is illegal. On the other hand, the sentence 


“Noiseless blue sounds sit cross-legged under the mountaintop” 


is properly constructed, but completely meaningless. 

For another example, § may consist of the integers, the symbols +, —, X, 
and ~, and left and right parentheses. We will obtain a language if we designate 
as proper those strings in S* that represent unambiguously parenthesized alge- 
braic expressions. Thus 


(3 -2)+(4x7))+9 and (7~(8—(9—10))) 


are properly constructed “sentences” in this language. On the other hand, 
(2 — 3)) + 4,4 — 3 — 2,and )2 + (3 —) X 4 are not properly constructed. The 
first has too many parentheses, the second has too few (we do not know which 
subtraction to perform first), and the third has parentheses and numbers com- 
pletely out of place. All properly constructed expressions have meaning except 
those involving division by zero. The meaning of an expression is the rational 
number it represents. Thus the meaning of ((2 — 1) + 3) + (4 X 6) is 73/3, while 
2 + (3 + 0) and (4 + 2) — (0 + 0) are not meaningful. 

The specification of the proper construction of sentences is called the syn- 
tax of a language. The specification of the meaning of sentences is called the 
semantics of a language. Among the languages that are of fundamental impor- 
tance in computer science are the programming languages. These include 
BASIC, FORTRAN, Modula, PASCAL, C**, LISP, ADA, FORTH, and many 
other general and special-purpose languages. When students are taught to pro- 
gram in some programming language, they are actually taught the syntax of the 
language. In a compiled language such as FORTRAN, most mistakes in syntax 
are detected by the compiler, and appropriate error messages are generated. The 
semantics of a programming language forms a much more difficult and advanced 
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topic of study. The meaning of a line of programming is taken to be the entire 
sequence of events that takes place inside the computer as a result of executing 
or interpreting that line. 

We will not deal with semantics at all. We will study the syntax of a class of 
languages called phrase structure grammars. Although these are not nearly com- 
plex enough to include natural languages such as English, they are general 
enough to encompass many languages of importance in computer science. This 
includes most aspects of prograinming languages, although the complete specifi- 
cation of some higher-level programming languages exceeds the scope of these 
grammars. On the other hand, phrase structure grammars are simple enough to 
be studied precisely, since the syntax is determined by substitution rules. The 
grammars that will occupy most of our attention lead to interesting examples of 
labeled trees. 


Grammars 


A phrase structure grammar G is defined to be a 4-tuple (V, S, vo, >), where V is 
a finite set, S is a subset of V, v. © V — S, and + is a finite relation on V*. The 
idea here is that S is, as discussed above, the set of all allowed “words” in the lan- 
guage, and V consists of § together with some other symbols. The element v, of 
V is a Starting point for the substitutions, which will shortly be discussed. Finally, 
the relation > on V* specifies allowable replacements, in the sense that, if 
wt> w’, we may replace w by »” whenever the string w occurs, either alone or as 
a substring of some other string. Traditionally, the statement w +> w’ is called a 
production of G. Then w and w’ are termed the left and right sides of the pro- 
duction, respectively. We assume that no production of G has the empty string A 
as its left side. We will call > the production relation of G. 

With these ingredients, we can introduce a substitution relation, denoted by 
=, on V*. We let x => y mean thatx =1-wer,y = 1+w'-r,and wr w’, where 
Zand r are completely arbitrary strings in V*. In other words, x = y means that y 
results from x by using one of the allowed productions to replace part or all of x. 
The relation = is usually called direct derivability. Finally, we let =~ be the tran- 
sitive closure of => (see Section 4.3), and we decree that’a string w in S* is a syn- 
tactically correct sentence if and only if v) >” w. In more detail, this says that a 
string w is a properly constructed sentence if w is in S*, not just in V*, and if we 
can get from Vv) to w by making a finite number of substitutions. This may seem 
complicated, but it is really a simple idea, as the following examples will show. 

If G = (V,S, vo) is a phrase structure grammar, we will call S the set of 
terminal symbols and N = V — S the set of nonterminal symbols. Note that 
V=SUN. 

The reader should be warned that other texts have slight variations of the 
definitions and notations that we have used for phrase structure grammars. 


Example 1. Let § = {John, Jill, drives, jogs, carelessly, rapidly, frequently}, 
N = {sentence, noun, verbphrase, verb, adverb}, and let V = $ U N. Let vy) = 
sentence, and suppose that the relation > on V* is described by listing all pro- 
ductions as follows. 
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sentence +> noun verbphrase 
noun +> John 
noun > Jill 
verbphrase +> verb adverb 

verb +> drives 
verb +> jogs 

adverb +> carelessly 

adverb +> rapidly 

adverb +> frequently 


The set S contains all the allowed words in the language; N consists of words that 
describe parts of sentences, but that are not actually contained in the language. 

We claim that the sentence “Jill drives frequently,” which we will denote by 
w, is an allowable or syntactically correct sentence in this language. To prove this, 
we consider the following sequence of strings in V*. 


sentence 

noun verbphrase 

Jill verbphrase 

Jill verb adverb 

Jill drives adverb 

Jill drives frequently 


Now each of these strings follows from the preceding one by using a production 
to make a partial or complete substitution. In other words, each string is related 
to the following string by the relation >, so sentence =” w. By definition then, w 
is syntactically correct since, for this example, vy is sentence. In phrase structure 
grammars, correct syntax simply refers to the process by which a sentence is 
formed, nothing else. aa 


It should be noted that the sequence of substitutions that produces a valid 
sentence, a sequence that will be called a derivation of the sentence, is not unique. 
The following derivation produces the sentence w of Example 1, but is not iden- 
tical with the derivation given there. 


sentence 

noun verbphrase 

noun verb adverb 
noun verb frequently 
noun drives frequently 
Jill drives frequently 


The set of all properly constructed sentences that can be produced using a 
grammar G is called the language of G and is denoted by L(G). The language of 
the grammar given in Example 1 is a somewhat simple-minded sublanguage of 
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English, and it contains exactly 12 sentences. The reader can verify that “John 
jogs carelessly” is in the language L(G) of this grammar, while “Jill frequently 


jogs” is not in L(G). 


It is also true that many different phrase structure grammars may produce 
the same language; that is, they have exactly the same set of syntactically correct 
sentences. Thus a grammar can.iot be reconstructed from its language. In Section 


10.2 we will give examples in which different grammars are used to construct the 


same language. 


sentence 
noun verbphrase 
(a) 
sentence 
noun verbphrase 
Jill verb adverb 
(c) 
/ 
noun 
Jille ~~ verb 


drives 


Figure 10.1 


sentence 


sentence 
noun verbphrase 
Jill 
(b) 
sentence 
noun verbphrase 
Jille verb adverb 
drives 
(a) 
verbphrase 
adverb 
frequently 
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Example 1 illustrates the process of derivation of a sentence in a phrase 
structure grammar. Another method that may sometimes be used to show the 
derivation process is the construction of a derivation tree for the sentence. The 
starting symbol, vo, is taken as the label for the root of this tree. The level-1 ver- 
tices correspond to and are labeled in order by the various words involved in the 
first substitution for vj. Then the offspring of each vertex, at every succeeding 
level, are labeled by the various words (if any) that are substituted for that ver- 
tex the next time it is subjected to substitution. Consider, for example, the first 
derivation of sentence w in Example 1. Its derivation tree begins with “sentence,” 
and the next-level vertices correspond to “noun” and “verbphrase” since the first 
substitution replaces the word “sentence” with the string “noun verbphrase.” This 
part of the tree is shown in Figure 10.1(a). Next, we substitute “Jill” for “noun,” 
and the tree becomes as shown in Figure 10.1(b). The next two substitutions, 
“verb adverb” for “verbphrase” and “drives” for “verb,” extend the tree as shown 
in Figure 10.1(c) and (d). Finally, the tree is completed with the substitution of 
“frequently” for “adverb.” The finished derivation tree is shown in Figure 10.1(e). 

The second derivation sequence, given in Example 1 for the sentence w, 
yields a derivation tree in the stages shown in Figure 10.2. Notice that the same 
tree results in both figures. Thus these two derivations yield the same tree, and 
the differing orders of substitution simply create the tree in different ways. The 
sentence being derived labels the leaves of the resulting tree. 


Example 2. Let V = {vo, w, a, b,c}, S = {a, b,c}, and let > be the relation on V* 
given by 


1. vo aw. 2. wr> bbw. 3. wee. 


Consider the phrase structure grammar G = (V, S, vo, +). To derive a sen- 
tence of L(G), it is necessary to perform successive substitutions, using (1), (2), 
and (3) above, until all symbols are eliminated other than the terminal symbols 
a, b, and c. Since we begin with the symbol v,, we must first use production (1), 
or we could never eliminate v,. This first substitution results in the string aw. We 
may now use (2) or (3) to substitute for w. If we use production (2), the result will 
contain a w. Thus one application of (2) to aw produces the string ab’w (a sym- 
bol b” means 1 consecutive b’s). If we then use (2) again, we will have the string 
ab‘w. We may use production (2) any number of times, but we will finally have to 
use production 3 to eliminate the symbol w. Once we use (3), only terminal sym- 
bols remain, so the process ends. We may summarize this analysis by saying that 
L(G) is the subset of S* corresponding to the regular expression a(bb)*c (see 
Section 1.3). Thus the word ab‘c is in the language of G, and its derivation tree is 
shown in Figure 10.3. Note that, unlike the tree of Example 1, the derivation tree 
for ab°c is not a binary tree. 


Example 3. Let V = {v),w,a, b,c}, S = {a, b,c}, and let > be a relation on V* 
given by 


1. vote ayyb. 2. vybte bw. 3. abwroc, 
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sentence 


noun verbphrase 


(a) 


sentence 


noun verbphrase 


verb adverh 


frequently 
(c) 
vA 
noun 
Jill verb 


drives 


Figure 10.2 


sentence 


noun verbphrase 


adverb 
(b) 


sentence 


noun verbphrase 


adverb 


drives @ frequently 


(d) 


sentence 


verbphrase 


adverb 


frequently 


Sec. 10.1 Languages 375 


Figure 10.3 


Let G = (V, S, vg,) be the corresponding phrase structure grammar. As we did 
in Example 2, we determine the form of allowable sentences in L(G). 

Since we must begin with the symbol v, alone, we must use production (1) 
first. We may continue to use (1) any number of times, but we must eventually use 
production (2) to eliminate vo, Repeated use of (1) will result in a string of the 
form a”v,)b"; that is, there are equal numbers of @’s and b’s. When (2) is used, the 
result is a string of the form a”(abw)b™ with m = 0. At this point the only pro- 
duction that can be used is (3), and we must use it to remove the nonterminal 
symbol w. The use of (3) finishes the substitution process and produces a string 
in S*. Thus the allowable sentences L(G) of the grammar G all have the form 
w = a"cb", where n = 0. In this case it can be shown that L(G) does not corre- 
spond to a regular expression over S. Sa 


Another interesting feature of the grammar in Example 3 is that the deriva- 
tions of the sentences cannot be expressed as trees. Our construction of deriva- 
tion trees works only when the left-hand sides of all productions used consist of 
single, nonterminal symbols. The left-hand sides of the productions in Example 3 
do not have this simple form. Although it is possible to construct a graphical rep- 
resentation of these derivations, the resulting digraph would not be a tree. Many 
other problems can arise if no restrictions are placed on the productions. For this 
reason, a classification of phrase structure grammars has been devised. 

Let G = (V,S,v9,+>) be a phrase structure grammar. Then we say that G is 
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Type 0 if no restrictions are placed on the productions of G. 


Type 1 if for any production w, > w,, the length of w, is less than or equal 
to the length of w, (where the length of a string is the number of words 
in that string). 


Type 2 if the left-hand side of each production is a single, nonterminal sym- 
bol and the right-hand side consists of one or more symbols. 


Type 3 if the left-hand side of each production is a single, nonterminal sym- 
bol and the right-hand side has one or more symbols, including at most 
one nonterminal symbol, which must be at the extreme right of the 
string. 


In each of the preceding types, we permit the inclusion of the trivial pro- 
duction v) > A, where A represents the empty string. This is an exception to the 
defining rule for types 1, 2, anc 3, but it is included so that the empty string can 
be made part of the language. This avoids constant consideration of unimportant 
special cases. 

Tt follows from the definition that each type of grammar is a special case of 
the type preceding it. Example 1 is a type 2 grammar, Example 2 is type 3, and 
Example 3 is type 0. Grammars of types 0 or 1 are quite difficult to study and lit- 
tle is known about them. They include many pathological examples that are of no 
known practical use. We will restrict further consideration of grammars to types 
2 and 3. These types have derivation trees for the sentences of their languages, 
and they are sufficiently complex to describe many aspects of actual program- 
ming languages. Type 2 grammii's are sometimes called context-free grammars, 
since the symbols on the left of the productions are substituted for wherever they 
occur. On the other hand, a production of the type ]- w- rol: w’- r (which 
could not occur in a type 2 grainmar) is called context sensitive, since w’ is sub- 
stituted for w only in the context where it is surrounded by the strings / and r. 
Type 3 grammars have a very clcse relationship with finite-state machines. Type 
3 grammars are also called regular grammars. 

A language will be called type 2 or type 3 if there is a grammar of type 2 or 
type 3 that produces it. This concept can cause problems. Even if a language is 
produced by a nontype 2 gramrnar, it is possible that some type 2 grammar also 
produces this same language. In this case, the language is type 2. The same situa- 
tion may arise in the case of type 3 grammars. 

The process we have considered in this section, namely deriving a sentence 
within a grammar, has a converse process. The converse process involves taking 
a sentence and verifying that it is syntactically correct in some grammar G by 
constructing a derivation tree that will produce it. This process is called parsing 
the sentence, and the resulting derivation tree is often called the parse tree of the 
sentence. Parsing is of fundamental importance for compilers and other forms of 
language translation. A sentence in one language is parsed to show its structure, 
and a tree is constructed. The tree is then searched and, at each step, corre- 
sponding sentences are generated in another language. In this way a C'' pro- 
gram, for example, is compiled irto a machine-language program. The contents 
of this section and the next two sections are essential to the compiling process, 
but the complete details must be left to a more advanced course. 


EXERCISE SET 10.1 


In Exercises 1 through 7, a grammar G will be 
specified. In each case describe precisely the lan- 
guage, L(G), produced by this grammar; that is, 
describe all syntactically correct “sentences.” 


L. G =(V,S,¥,) 
V = [Yo Vp X.¥s 25 = (ey, Z 
ee: Vo t> XVo 
Vor y vy 
yroyy 
Viz 


2. >t Voth XV 
G = (V,S, vp.) 
V = {v9 a}, 5 = (a 
Het Wyte aavy 
Vy aa 


3. G = (V,S, ¥),>) 
V = {v,a, b}, S = {a, b} 
>t Vy aar, 
Vea 
Ytreb 


4. G=(V,S, V+) 
Vs {¥p, 4, Ys 2,8 = {x.y, z} 
Pt Vy XV 
Vor Y Vo 
Vot>Z 


§. G = (V,S, v9) 

4 x {Yo Vy, V2, a, t+, G } 

S=((),a, 4] 

+> V9 +> (V9) (where left and right parentheses 

are symbols from S$) 

Vat vy 
Wreatv, 
Vat vy 
vz a 


6. G = (V,S,v),>) 
V = {vp, v), a, b}, S = {a, b} 
Divyravy 
VjtH> bv 
vyrwa 


7. 


9. 


10 


11. 
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G = (V,S, v4) 
Vs (Vo, Vis Var % Ys zy, S Ps ty, z} 
F>IVg th Vo Vy 

Yo Vp > ¥2 My 

Vy Vor>xy 

Vax 

VireZ 


For each grammar in Exercises 1 through 7, 
state whether the grammar is type 1, 2, or 3. 


Let G = (V,S,1,+>), where 


V ={L,L,D, W,a,b, c,0, 1,2,3.4, 5, 6, 7,8, 9} 
S = (a,b,c, 0,1.2,3,4,5, 6, 7,8, 9} 


+ is given by: 


LIL 8. Leb 
2. I-> LW 9 Lee 
3. We LW 10. De 0 
4.We DW 11. Del 
5. WeL : 

6. We D 19. DRY 
7. Lea 


Which of the following statements are true for 
this grammar? 

(a) ab092 € L(G) 
(b) 2a3b € L(G) 
(c) aaaa € L(G) 
(d) l>a 

(e) 1=>* ab 

(f) DW=2 

(g) DW =>*2 

(h) W =>” 2abe 
Gi) W=” ba2c 


If G is the grammar of Exercise 9, describe 
L(G). 


Draw a derivation tree for ab3 in the grammar 
of Exercise 9. 


Draw a derivation tree for the string x’y’z in 
the grammar of Exercise t. 
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13. Draw a derivation tree for the string aba’ in the 20. L = {a"b" |\n = 1,m= 1} 


grammar of Exercise 6. 


14, Draw a derivation tree for the string a® in the 


21. L = {a"b"|n = 3} 


grammar of Exercise 2. 22, L = {a"b™|n =1,m = 3} 


15. 


Give two distinct derivations (sequences of 3 
substitutions that start at v)) for the string 
xyz € L(G), where G is the grammar of 


. L = {x"y"|n = 2,m nonnegative and even} 


24, L = {x"y™| n even, m positive and odd} 


Exercise 7. 
16. Let G be the grammar of Exercise 5. Can you 25. Let G = (V,S, vo, >) where 
give two distinct derivations (see Exercise 15) V = {¥o Yi, Vx, a, b,c}, S = {a,b,c} 
for the string ((a + a + a))? >. Voth davy 
Vot> bv, 
17. Let G be the grammar of Exercise 9. Give two vyraevb 
distinct derivations (see Exercise 15) of the v +> cb 
string 2100. v, +> bbv, 
v,+> bb 
In Exercises 18 through 24, construct a phrase . 
structure grammar G such that the language, State which of the following are in L(G). 
L(G), of G is equal to the language L. (a) aabeb 
(b) abbcb 


18. L = {a"b"|n=1} 


(c) aaaabcbb 
(d) aaaabcbbb 


19, L = {strings of 0’s and 1’s with an equal num- (e) abchbbbb 
ber n = 0 of 0’s and 1’s} 


10.2. Representations of Special Grammars 


and Languages 


BNF Notation 


For type 2 grammars (which inciude type 3 grammars), there are some useful, 
alternative methods of displaying the productions. A commonly encountered 
alternative is called the BNF notation (for Backus-Naur form). We know that the 
left-hand sides of all productions in a type 2 grammar are single, nonterminal 
symbols, For any such symbol w, we combine all productions having w as the left- 
hand side. The symbol w remains on the left, and all right-hand sides associated 
with w are listed together, separated by the symbol |. The relational symbol + is 
replaced by the symbol ::=. Finally, the nonterminal symbols, wherever they 
occur, are enclosed in pointed brackets ( ). This has the additional advantage that 
nonterminal symbols may be permitted to have embedded spaces. Thus 
{word1 word2) shows that the string between the brackets is to be treated as one 
“word,” not as two words. That is, we may use the space as a convenient and legit- 
imate “letter” in a word, as long as we use pointed brackets to delimit the words. 
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Example J. In BNF notation, the productions of Example 1 of Section 10.1 
appear as follows. 


(sentence) ::= (noun) (verbphrase) 

{noun) 2: = John | Jill 

(verbphrase) :: = (verb) (adverb) 

(verb) ::= drives | jogs 

(adverb) :1= carelessly | rapidly | frequently Sa 


Example 2, In BNF notation, the productions of Example 2 of Section 10.1 
appear as follows. 


(yp) = abv) 
(w) = bb(w) le . 


Note that the left-hand side of a production may also appear in one of the 
strings on the right-hand side. Thus, in the second line of Example 2, (w) appears 
on the left, and it appears in the string bb(w) on the right. When this happens, we 
say that the corresponding production w — bbw is recursive. If a recursive pro- 
duction has w as left-hand side, we will say that the production is normal if w 
appears only once on the right-hand side and is the rightmost symbol. Other non- 
terminal symbols may also appear on the right side. The recursive production 
w -> bbw given in Example 2 is normal. Note that any recursive production that 
appears in a type 3 (regular) grammar is normal, by the definition of type 3. 


Example 3. BNF notation is often used to specify actual programming lan- 
guages. PASCAL and many other languages had their grammars given in BNF 
initially. In this example, we consider a small subset of PASCAL’s grammar. This 
subset describes the syntax of decimal numbers and can be viewed as a mini- 
grammar whose corresponding language consists precisely of all properly formed 
decimal numbers. 

Let S = {0,1,2,3, 4, 5,6, 7,8, 9, .}. Let V be the union of S with the set 


N = {decimal-number, decimal-fraction, unsigned-integer, digit}. 


Then let G be the grammar with symbol sets V and S, with starting symbol “dec- 
imal-number” and with productions given in BNF form as follows: 


1. (decimal-number) :: = (unsigned-integer) | (decimal-fraction) | 
{unsigned-integer) (decimal-fraction) 
2. <decimal-fraction) ::= . (unsigned-integer) 
3. (unsigned-integer) :: = (digit) | (digit) (unsigned-integer) 
4, (digit) ::=0{1/2/314|5/617/81/9 
Figure 10.4 shows a derivation tree, in this grammar, for the decimal num- 
ber 23.14, Notice that the BNF statement numbered 3 is recursive in the second 


part of its right-hand side. That is, the production “unsigned-integer +> digit 
unsigned-integer” is recursive, and it is also normal. In general, we know that 
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decimal-number 


unsigned-integer decimal-fraction 


: , unsigned-integer 
unsigned- integer 


unsigned-integer 


Figure 10.4 


many different grammars may produce the same language. If the line numbered 
3 above were replaced by the line: 


3’. (unsigned-integer) :: = (digit) | (unsigned-integer) (digit) 


we would have a different grammar that produced exactly the same language, 
namely the correctly formed decimal numbers. However, this grammar contains 
a production that is recursive but not normal. og 


Example 4. As in Example 3, we give a grammar that specifies a piece of 
several actual programming languages. In these languages, an identifier (a name 
for a variable, function, subroutine, and so on) must be composed of letters and 
digits and must begin with a letter. The following grammar, with productions 
given in BNF, has precisely these identifiers as its language. 
G = (V,5S, identifier, +) 
N = {identifier, remaining, digit, letter} 
S = {a, b,e,...,2,0,1,2,3,..., 9}, V=NUS 
1. (identifier) :: = (letter) | (letter)(remaining) 
2. (remaining) :: = (letter) | digit) | (letter)(remaining) | (digit){remaining) 
3. etter) :=a|b\c---\z 
4. (digit) ::=0|1!2\3|4 5|6!7|/8|9 
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Again we see that the productions “remaining +> letter remaining” and 
“remaining +> digit remaining,” occurring in BNF statement 2, are recursive and 
normal. ° 


Syntax Diagrams 


A second alternative method for displaying the productions in some type 2 gram- 
mars is the syntax diagram. This is a pictorial display of the productions that 
allows the user to view the substitutions dynamically, that is, to view them as 
movement through the diagram. We will illustrate, in Figure 10.5, the diagrams 
that result from translating typical sets of productions, usually all the productions 
appearing on the right-hand side of some BNF statement. 


2#$—fn FP] Fn 
(a) 


(d) e) 
Figure 10.5 
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A BNF statement that involves just a single production, such as (w) ::= 
(w1)(w>)(w,), Will result in the diagram shown in Figure 10.5(a). The symbols 
(words) that make up the right-hand side of the production are drawn in 
sequence from left to right. The arrows indicate the direction in which to move to 
accomplish a substitution, while the label w indicates that we are substituting for 
the symbol w. Finally, the rectangles enclosing w,, w,, and w, denote the fact that 
these are nonterminal symbols. If terminal symbols were present, they would 
instead be enclosed in circles or ellipses. Figure 10.5(b) shows the situation when 
there are several productions with the same left-hand side. This figure is a syntax 
diagram translation of the following BNF specification: 


(w) == (wy)<a¥9) | (ry) | Becve) 


(where a, b, and c are terminal symbols). Here the diagram shows that when we 
substitute for w, by moving through the figure in the direction of the arrows, 
we may take any one of three paths. This corresponds to the three alternative 
substitutions for the symbol w. Now consider the following normal, recursive pro- 
duction, in BNF form: 


dw) i: = ab w). 


The syntax diagram for this production is shown in Figure 10.5(c). If we go 
through the loop once, we encounter a, then b, and we then return to the starting 
point designated by w. This represents the recursive substitution of abw for w. 
Several trips around the diagrara represent several successive substitutions. Thus, 
if we traverse the diagram three times and return to the starting point, we see that 
w will be replaced by abababw in three successive substitutions, This is typical of 
the way in which movement through a syntax diagram represents the substitution 
process. 

The remarks above show how to construct a syntax diagram for a normal 
recursive production. Nonnormal recursive productions do not lead to the simple 
diagrams discussed, but we may sometimes replace nonnormal, recursive pro- 
ductions by normal recursive productions and obtain a grammar that produces 
the same language. Since recursive productions in regular grammars must be nor- 
mal, syntax diagrams can always be used to represent regular grammars. 

We also note that syntax diagrams for a language are by no means unique. 
They will not only change wher different, equivalent productions are used, but 
they may be combined and simplified in a variety of ways. Consider the follow- 
ing BNF specification: 


(wy t= ab | ab(w). 


If we construct the syntax diagram for w using exactly the rules presented, we will 
obtain the diagram of Figure 1().5(d). This shows that we can “escape” from w, 
that is, eliminate w entirely, only by passing through the upper path. On the other 
hand, we may first traverse the lower loop any number of times. Thus any move- 
ment through the diagram that eventually results in the complete elimination of 
w by successive substitutions will! produce a string of terminal symbols of the 
form (ab)",n = 1. 
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v 
Or OS 


(a) (b) 
Figure 10.6 


identifier 


letter 
remaining 


remaining 


letter 


digit 


Figure 10.7 


384 


Chapter 10 


Languages and Finite-State Machines 


It is easily seen that the simpler diagram of Figure 10.5(e), produced by 
combining the paths of Figure 19.5(d) in an obvious way, is an entirely equivalent 
syntax diagram. These types of simplifications are performed whenever possible. 


Example 5. The syntax diagrams of Figure 10.6(a) represent the BNF state- 
ments of Example 2, constructed with our original rules for drawing syntax dia- 
grams. A slightly more aesthetic version is shown in Figure 10.6(b). Sd 


Example 6. Consider the BNF statements 1,2, 3, and 4 of Example 4. The direct 
translation into syntax diagrams is shown in Figure 10.7. In Figure 10.8 we com- 
bine the first two diagrams of Figure 10.7 and simplify the result. We thus elimi- 
nate the symbol “remaining,” and we arrive at the customary syntax diagrams for 
identifiers. Sd 


Example 7. The productions of Example 3, for well-formed decimal numbers, 
are shown in syntax diagram forni in Figure 10.9, Figure 10.10 (see p. 386) shows 
the result of substituting the diagram for “unsigned-integer” into that for ‘“‘deci- 
mal-number” and “decimal-fraction.” In Figure 10.11 (see p. 386) the process of 
substitution is carried one step further. Although this is not usually done, it does 
illustrate the fact that we can be very flexible in designing syntax diagrams. 


es. 


letter 


digit 


Figure 10.8 


identifier 
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unsigned-integer 
decimal-fraction 


unsigned-integer 


decimal-fraction 


decimal-fraction 
(+) unsigned-integer 


unsigned-integer 


RVVVRVLVVP 


Figure 10.9 


digit 


If we were to take the extreme case and combine the diagrams of Figure 
10.11 into one huge diagram, that diagram would contain only terminal symbols. 
In that case a valid “decimal-number” would be any string that resulted from 
moving through the diagram, recording each symbol encountered in the order in 
which it was encountered, and eventually exiting to the right. 


Regular Grammars and Regular Expressions 


There is a close connection between the language of a regular grammar and a 
regular expression (see Section 1.3). We state the following theorem without 
proof. 


Theorem 1. Let S be a finite set,and L C S*. Then L is a regular set if and only 
if L = L(G) for some regular grammar G = (V,S, Vo, >). od 


Theorem 1 tells us that the language L(G) of a regular grammar G must be 
the set corresponding to some regular expression over S, but it does not tell us 
how to find such a regular expression. If the relation > of G is specified in BNF 
or syntax diagram form, we may compute the regular expression desired in a rea- 
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decimal-number 
decirnal-fraction 


decimal-fraction 


decimal-fraction 


RARARVLYVY 


Figure 10.10 


digit 


decimal 
number 


digit 


Figure 10.11 
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sonably straightforward way. Suppose, for example, that G = (V, S, vy, >) and 
that +> is specified by a set of syntax diagrams. As we previously mentioned, it is 
possible to combine all the syntax diagrams into one large diagram that repre- 
sents Vy) and involves only terminal symbols. We will call the result the master dia- 
gram of G. Consider the following rules of correspondence between regular 
expressions and parts, or segments, of the master diagram of G. 


1. Terminal symbols of the diagram correspond to themselves, as regular 
expressions. 

2. If a segment D of the diagram is composed of two segments D, and D, 
in sequence, as shown in Figure 10.12(a), and if D, and D, correspond to 
regular expressions a, and a,, respectively, then D corresponds to a,ap. 

3. If a segment D of the diagram is composed of alternative segments D, 
and D,, as shown in Figure 10.12(b), and if D, and D, correspond to reg- 
ular expressions a, and a,, respectively, then D corresponds to a, V a. 

4. If a segment D of the diagram is a loop through a segment D,, as shown 
in Figure 10.12(c), and if D, corresponds to the regular expression a, 
then D corresponds to a*. 


(a) (b) 


(c) 
Figure 10.12 


Rules 2 and 3 extend to any finite number of segments D, of the diagram. 
Using the foregoing rules, we may construct the single expression that corre- 
sponds to the master diagram as a whole. This expression is the regular expres- 
sion that corresponds to L(G). 


Example 8. Consider the syntax diagram shown in Figure 10.13(a). It is com- 
posed of three alternative segments, the first corresponding to the expression “a,” 
the second to the expression “b,” and the third, a loop, corresponding to the 
expression “c*’’. Thus the entire diagram corresponds to the regular expression 


“al bV c#”. 
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(a) 


(b) 


(c) 
Figure 10.13 


The diagram shown in Figure 10.13(b) is composed of three sequential seg- 
ments. The first segment is itself composed of two alternative subsegments, and it 
corresponds to the regular expression “a VV b”. The second component segment 
of the diagram corresponds to the regular expression “c”, and the third compo- 
nent, a loop, corresponds to the regular expression “d*”. Thus the overall diagram 
corresponds to the regular expression “(a V b)cd*”. 

Finally, consider the syntax diagram shown in Figure 10.13(c). This is one 
large loop through a segment that corresponds to the regular expression “a V bc”. 
Thus the entire diagram corresponds to the regular expression “(a V bc)*”.  @ 


Example 9. Consider the grammar G given in BNF in Example 2. Syntax dia- 
grams for this grammar were discussed in Example 5 and shown in Figure 
10.6(b). If we substitute the diagram representing w into the diagram that repre- 
sents Vp, we get the master diagrain for this grammar. This is easily visualized, and 
it shows that L(G) corresponds to the regular expression “a(bb)*c”, as we stated 
in Example 2 of Section 10.1. SO 


Example 10. Consider the grammar G of Examples 4 and 6. Then L(G) is the 
set of legal identifiers, whose syritax diagrams are shown in Figure 10.8. In Figure 
10,14 we show the master diagram that results from combining the diagrams of 
Figure 10.7. It follows that a regular expression corresponding to L(G) is 


“aVbVe-VzlaVvVoVe-VzVOVIV---V 9”, e 
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The type of diagram segments illustrated in Figure 10.12 can be combined 
to produce syntax diagrams for any regular grammar. Thus we may always pro- 
ceed as illustrated above to find the corresponding regular expression. With prac- 
tice one can learn to compute this expression directly from multiple syntax dia- 
grams or BNF, thus avoiding the need to make a master diagram. In any event, 
complex cases may prove too cumbersome for hand analysis. 


identifier 


Figure 10.14 


EXERCISE SET 10.2 


In each of Exercises 1 through 5, we have refer- 6. Give the BNF for the productions of Exercise 3 
enced a grammar described in the exercises of a of Section 10.1. 

previous section. In each case, give the BNF and 
corresponding syntax diagrams for the produc- 

tions of the grammar. 7 


Give the BNF for the productions of Exercise 4 


1. Exercise 1 of Section 10.1. of Section 10.1. 


2. Exercise 2 of Section 10.1. 


8. Give the BNF for the productions of Exercise 5 
3. Exercise 6 of Section 10.1. of Section 10.1. 
4. Exercise 9 of Section 10.1. 

9. Give the BNF for the productions of Exercise 6 


5. Exercise 25 of Section 10.1. of Section 10,1, 
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10. Let G = (V,S, vo, +), where V = {v, vy, 0, 1}, 
S = {0,1}, and 
rei vgt> Ov, 
vy, 11v, 
v,+> 010v, 
yell 
Give the BNF representation for the produc- 
tions of G. 


In Exercises 11 and 12, give a BNF representa- 
tion for the syntax diagram shown. The symbols 
a, b, c, and d are terminal symbols of some 
grammar. You may provide nonterminal sym- 
bols as needed (in addition to vo), to use in the 
BNF productions. You may use several BNF 
statements if needed. 


1L. VY 


Figure 10.15 


Figure 10.16 
In each of Exercises 13 through 17, we have ref- 
erenced a grammar G, described in the exercises 


of a previous section. In each case find a regular 
expression that corresponds to the language 


L(G). 
13. Exercise 2 of Section 10.1, 


14, Exercise 3 of Section 10.1. 
15. Exercise 5 of Section 10.1. 
16. Exercise 6 of Section 10.1. 


17. Exercise 9 of Section 10.1. 


18. Find the regular expression that corresponds to 
the syntax diagram of Exercise 11. 


19. Find the regular expression that corresponds to 
the syntax diagram of Exercise 12. 


20. Find the regular expression that corresponds to 
L(G) for G given in Exercise 10. 
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10.3. Finite-State Machines 


We think of a machine as a system that can accept input, possibly produce out- 
put, and have some sort of internal memory that can keep track of certain infor- 
mation about previous inputs. The complete internal condition of the machine 
and all of its memory, at any particular time, is said to constitute the state of the 
machine at that time. The state in which a machine finds itself at any instant sum- 
marizes its memory of past inputs and determines how it will react to subsequent 
input. When more input arrives, the given state of the machine determines (with 
the input) the next state to be occupied, and any output that may be produced. If 
the number of states is finite, the machine is a finite-state machine. 

Suppose that we have a finite set S = {so,5,,...,5,}, a finite set J, and for 
each x € J, a function f,: § > S. Let ¥ = {f, | x € I}. The triple (S, J, ¥) is called 
a finite-state machine, S is called the state set of the machine, and the elements 
of S are called states. The set Jis called the input set of the machine. For any input 
x € IJ, the function f, describes the effect that this input has on the states of the 
machine and is called a state transition function. Thus, if the machine is in state s, 
and input x occurs, the next state of the machine will be f,(s,). 

Since the next state f,(s;) is uniquely determined by the pair (s;, x), there is 
a function F: S X I S given by 


F (s,,x) = f,(s))- 
The individual functions f, can all be recovered from a knowledge of F. Many 


authors will use a function F: S X I > S, instead of a set {f,|x € 1], to define a 
finite-state machine. The definitions are completely equivalent. 


Example 1. Let S = {so,s,} and J = {0, 1}. Define fy and f, as follows: 


folS0) = So, filo) = S, 
fos) = 51 Aisi) = So. 


This finite-state machine has two states, s) and s,, and accepts two possible 
inputs, 0 and 1. The input 0 leaves each state fixed, and the input 1 reverses states. 
We can think of this machine as a model for a circuit (or logical) device and visu- 
alize such a device as in Figure 10.17. The output signals will, at any given time, 
consist of two voltages, one higher than the other. Either line 1 will be at the 
higher voltage and line 2 at the lower, or the reverse. The first set of output condi- 
tions will be denoted s, and the second will be denoted s,. An input pulse, repre- 
sented by the symbol 1, will reverse output voltages. The symbol 0 represents the 
absence of an input pulse and so results in no change of output. This device is often 
called a T flip-flop and is a concrete realization of the machine in this example. 

We summarize this machine in Figure 10.18. The table shown there lists the 
states down the side and inputs across the top. The column under each input gives 
the values of the function corresponding to that input at each state shown on the 
left. 

The arrangement illustrated in Figure 10.18 for summarizing the effect of 
inputs on states is called the state transition table of the finite-state machine. It 
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ai Line 1 


Output signal 
Input signal 


- Line 2 
Figure 10.17 Figure 10.18 


can be used with any machine of reasonable size and is a convenient method of 
specifying the machine. ¢ 


Example 2. Consider the state transition table shown in Figure 10.19. Here a 
and 6 are the possible inputs, and there are three states, so, s,, and s,. The table 
shows us that 


Fil8o) = Sos FA(S1) = S95 F(S2) = 51 


and 


FolSo) = 515 Fi(S1) = Sos Fy(8o) = 52. ° 


Figure 10.19 


If M is a finite-state machine with states S, inputs /, and state transition 
functions {f, | x € J}, we can determine a relation R,, on S in a natural way. If 
5;,5; € S, we say that s; Ry 5; if there is an input x so that f,(s;) = 5;. 

Thus s; Rs; means that if the machine is in state s;, there is some input 
x € I that, if received next, will put the machine in state s;. The relation Ry per- 
mits us to describe the machine .V as a labeled digraph of the relation Ry on S, 
where each edge is labeled by the set of all inputs that cause the machine to 
change states as indicated by tha: edge. 


Example 3. Consider the machine of Example 2. Figure 10.20 shows the 
digraph of the relation R,,, with cach edge labeled appropriately. Notice that the 
entire structure of M can be recovered from this digraph, since edges and their 
labels indicate where each input sends each state. Sa 


Figure 10.20 
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Example 4. Consider the machine M whose state table is shown in Figure 
10.21(a). The digraph of R,, is then shown in Figure 10.21(b), with edges labeled 
appropriately. oa 


Note that an edge may be labeled by more than one input, since several 
inputs may cause the same change of state. The reader will observe that every 
input must be part of the label of exactly one edge out of each state. This is a gen- 
eral property that holds for the labeled digraphs of all finite-state machines. For 
brevity, we will refer to the labeled digraph of a machine M simply as the digraph 
of M. 


(b) 


Figure 10.21 


It is possible to add a variety of extra features to a finite-state machine in 
order to increase the utility of the concept. A simple, yet very useful extension 
results in what is often called a Moore machine, or recognition machine, which is 
defined as a sequence (S, I, ¥, 5), T), where (S, 1, #) constitutes a finite-state 
machine, s, € S and T C S. The state s, is called the starting state of M, and it will 
be used to represent the condition of the machine before it receives any input. 
The set T is called the set of acceptance states of M. These states will be used in 
Section 10.4 in connection with language recognition. 

When the digraph of a Moore machine is drawn, the acceptance states are 
indicated with two concentric circles, instead of one. No special notation will be 
used on these digraphs for the starting state, but unless otherwise specified, this 
state will be named 55. 


Example 5, Let M be the Moore machine (5S, J, ¥, 5), T), where (S, I, #) is 
the finite-state machine of Figure 10.21 and T = {s,, s,}. Figure 10.22 shows the 
digraph of M. 5 


Machine Congruence and Quotient Machines 


Let M = (S, I, ¥) be a finite-state machine, and suppose that R is an equivalence 
relation on S. We say that R is a machine congruence on M if, for any s,7 € S, 
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a, b,c 


Figure 10.22 


s R timplies that f(s) R f,( for all x € 1. In other words, R is a machine congruence 
if R-equivalent pairs of states are always taken into R-equivalent pairs of states by 
every input in J. If R is a machine congruence on M = (S, I, #), we let S = S/R be 
the partition of S corresponding to R (see Section 4.5).'Then S = {[s]|s € S}. 

For any input x € J, consider the relation f, on S defined by 


f= (Us) (4.)D)- 


If [s] = [#], then s R t; therefore, f,(s) R f,(d), so [f,(8)] = [f,()]. This shows that 
the relation, is a function from § to S, and we may write f,((s]) = [f,(s)] for all 
equivalence classes [s] in 5. If we let ¥ = {f,|x € J}, then the triple M = (5,1, ¥) 
is a finite-state machine called the quotient of M corresponding to R. We will also 
denote M by MIR. 

Generally, a quotient machine will be simpler than the original machine. We 
will show in Section 10.6 that it is often possible to find a simpler quotient 
machine that will replace the original machine for certain purposes. 


Example 6. Let M be the finite-state machine whose state transition table is 
shown in Figure 10.23. Then S = |59, 5, 59, 53, 54, 5s}. Let R be the equivalence rela- 
tion on § whose matrix is 


0100 0 
10101 
010 0 0 

Mee 101 0%1f 
00010 
101041 


Then we have S/R = {[so]. [si]. [all where [so] et {59,52} a [so], [s,] >, {51.53.55} = 
(s3] = [s5], and [s,] = {s,]. We check that R is a machine congruence. The state 
transition table in Figure 10.23 shows that f, takes each element of [s,] to an ele- 
ment of [s,] for i = 0,1, 4. Also, f, takes each element of [sp] to an element of [s,], 
each element of [s,] to an element of [so], and each element of [s,] to an element 
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of [s,]. These observations show that R is a machine congruence; the state transi- 
tion table of the quotient machine M/R is shown in Figure 10.24. a 


So So 54 [50] [So] [54] 
a ee [n] | i) [0] 
‘ 9 ‘ [S4] [$4] [$1] 
S4 S4 53 
55 $3 Sz 

Figure 10.23 Figure 10.24 


Example 7. Let J = (0, 1}, § = {59, 5), 5, 83, 54, 85, 8, 8}, and M = (S, I, #), the 
finite-state machine whose digraph is shown in Figure 10.25. 


Figure 10.25 


Suppose that R is the equivalence relation whose corresponding partition 
of S, S/R, is {{59, 54}, {81, 52, Ss}, {Se}. {83, S}}. Then it is easily checked, from the 
digraph of Figure 10.25, that R is a machine congruence. To obtain the digraph 
of the quotient machine M, draw a vertex for each equivalence class, [s] = 
{59.54}, [51] = {51,5255}. [Se] = {56}, [55] = {55 5>}, and construct an edge from [s,] to 
[s|] if there is, in the original digraph, an edge from some vertex in [s;] to some 
vertex in [s;]. In this case, the constructed edge is labeled with all inputs that take 
some vertex in [s,] to some vertex in [s,]. Figure 10.26 shows the result. The pro- 
cedure illustrated in this example works in general. ° 


If M = (8,1, ¥, So, T) is a Moore machine, and R is a machine congruence 
on M, then we may let T = ([2] | t € T). Here, the sequence M = 
(S, 7, , [so], T) is a Moore machine. In other words, we compute the usual quotient 
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Figure 10.26 


machine M/R; then we designate [s,] as a starting state, and let T be the set of 
equivalence classes of acceptance states. The resulting Moore machine M, con- 
structed this way, will be called the quotient Moore machine of M. 


Example 8. Consider the Moore machine (S, J, ¥, 5), T), where (S, I, ¥) is the 
finite-state machine of Example 6 and T is the set {s,, 55, s,}. The digraph of the 
resulting quotient Moore machine is shown in Figure 10.27. oa 


Figure 10.27 


EXERCISE SET 10.3 


In Exercises 1 through 4, draw the digraph of the 
machine whose state transition table is shown. 
Remember to label the edges with the appropri- 
ate inputs. 


So} 81 So 


$1] 520 54 
$2] 83 82 


531 53° 53 


In Exercises 5 through 8 (Figures 10.28 through 
10.31), construct the state transition table of the 


finite-state machine whose digraph is shown. 


Figure 10.30 
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b 


as 


ae al 


Figure 10.31 


9. 


10. 


IL. 


13. 


Let M = (S,/, ¥) be a finite-state machine. 
Define a relation R on / as follows: x, R x, if 
and only if f,,(s) = f,,(s) for every s in S. Show 
that R is an equivalence relation on /. 


Let (S, «) be a finite semigroup. Then we may 
consider the machine (S, 5, #), where ¥ = 

{f, |x © S), and f(y) = x * y for allx,y ES. 
Thus we have a finite-state machine in which 
the state set and the input are the same. Define 
a relation R on S as follows: x R y if and only if 
there is some z € § such that f,(x) = y. Show 
that R is transitive. 


Consider a finite group (S, *) and let (5, S, ¥) 
be the finite-state machine constructed in 
Exercise 10. Show that if R is the relation 
defined in Exercise 10, then R is an equivalence 
relation. 


Let / = {0,1} and S = {a, b}. Construct all 
possible state transition tables of finite-state 
machines that have S as state set and J as 
input set. 


Consider the machine whose state transition 
table is 


414 1 


Here S§ = {1,2,3, 4}. (a) Show that R = {(1, 1), 
(1, 4), (4, 1), (4, 4), (2, 2), (2, 3), G, 2), (3, 3)} is a 
machine congruence. (b) Construct the state 
transition table for the corresponding quotient 
machine. 
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14. Consider the machine whose state transition 


table is 


Sy 
Sq 
83 


mn 


So 
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So Sy So 
Sy 83 Sq 
S282 So 


Let R = {(59, 51), (S05 50), (515 51), (S11 50)s (S39 52)» 

(52, $2), (Sa, 53), (Sz, 53)}. 

(a) Show that R is a machine congruence. 

(b) Construct the digraph for the correspond- 
ing quotient machine. 


So 


8, 83 


0 0 


Consider the Moore machine whose digraph is Figure 10.32 


shown in Figure 10.32. Show that the relation R 
on S$ whose matrix is 


1 


Mg = 


oroc$§$jcee 


0 


mp OS OF 


coorrcoeo 
coorr CO 
COroocr 
Pooor.S 


is a machine congruence. Draw the digraph of 
the corresponding quotient Moore machine. 


10.4. Semigroups, Machines, and Languages 


Let M = (S, 1, ¥) be a finite-state machine with state set S = {59,5,,...,5,}, input 
set I, and state transition functions ¥ = {f,|x © I}. 

We will associate with M two monoids, whose construction we recall from 
Section 9.2. First, there is the free monoid 7* on the output set J. This monoid 
consists of all finite sequences (or “strings” or “words”) from J, with catenation 
as its binary operation, The identity is the empty string A. Second, we have the 
monoid S*, which consists of all functions from S$ to § and which has function 
composition as its binary operation. The identity in $° is the function 1, defined 
by 1,(s) = s, for all s in S. 

If w = x,x,---x, €J*, we let f, =f, ° fe, _,°°°°° A, the composition of 
the functions f, . fr, 1» -++>Jr,-Also we define f, to be 1,. In this way we assign 
an element f,, of S° to each element w of J* If we think of each f, as the effect of 
the input x on the states of the machine M, then f,, represents the combined 
effect of all the input letters in the word w, received in the sequence specified by 
w. We call f,, the state transition function corresponding to w. 
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Example 1. Let M = (S,J, #), where S = {so, 5,, 55}, J = {0, 1}, and & is given by 
the following state transition table. 


Let w = 011 € J*. Then 


FulSo) = Ke fi ° fo) 0) = AA ols0))) 
= f\AGo)) = AG) = 5. 


Similarly, 
Ful8.) = AAC D) = ACG) = Ao) = 51 


and 


FAS) = AA folsa))) = ACA.) = filsa) = So. Md 


Example 2. Let us consider the same machine M as in Example 1 and examine 
the problem of computing f, a little differently. In Example 1 we used the defi- 
nition directly, and for a large machine we would program an algorithm to com- 
pute the values of f,, in just that way. However, if the machine is of moderate size, 
humans may find another procedure to be preferable. 

We begin by drawing the digraph of the machine M as shown in Figure 
10.33. We may use this digraph to compute word transition functions by just fol- 
lowing the edges corresponding to successive input letter transitions. Thus, to 
compute f(s), we start at state s, and see that input 0 takes us to state sy. The 
input 1 that follows takes us on to state s,, and the final input of 1 takes us to s,. 
Thus f,,(59) = 5, as before. 


0 
1 
@ a 
Onn O=arxas © 
Figure 10.33 


Let us compute f,,, where w’ = 01011. The successive transitions of s,) are 


0 1 0 1 1 


So > So > Sy > Sy > So > Sy, 


so f,,,(So) = s,. Similar displays show that f,,(s,) = s, and f,,(s,) = So. 5 


This method of interpreting word transition functions such as f,, and f,,, is 
useful in designing machines that have word transitions possessing certain 
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desired properties. This is a crucial step in the practical application of the theory, 
and we will consider it in the next section. 

Let M = (S,/,#) be a finite-state machine. We define a function T from /* 
to S*. If w is a string in J*, let 7(w) = f, as defined previously. Then we have the 
following result. 


Theorem 1 
(a) If w, and w, are in I*, then T(w, - w.) = T(w) © T(w,). 
(b) If M = TU*), then Mis a submonoid of S*. 


Proof: (a) Let w, = x,x,---x, and w, = y,y.--- y,, be two strings in I*. 
Then T(w, + wy) = Tepe, +++ XY V2 °° + Ym) = Bin Foe 2 oA)? 
(fey Fg 12 oS) = TQ)  T(w,). Also, T(A) = 15 by definition. Thus T 
is a monoid homomorphism. 

(b) Part (a) shows thar if f and g are in J, then fo g and go f are in AL. 
Thus J is a subsemigroup of S°. Since 1, = T(A), 1s € Mt. Thus Jt is a sub- 
monoid of $°. The monoid A is called the monoid of the machine M.  # 


Example 3. Let S = {sp,5,,8,} and J = {a, b, d}. Consider the finite-state machine 
M = (S, I, ¥) defined by the digraph shown in Figure 10.34. Compute the func- 
tions frag Fada 204 fradaag> aNd verify that 


head ° Sraa = Fadadd: 


Figure 10.34 


Solution: frag is computed by the following sequence of transitions: 


b a d 
Sq Sy — 5 Sy 


b a d 
3 5 os Os, 


b a d 


S$, -—> Sy > 8, > Sy. 


Thus fi,ga8o) = 51+ fraa(5) = 51, and f,,4(52) = 8. 
Similarly, for faa 


80 f,aq(5;) = So for i = 0, 1,2. A similar computation shows that 


Fradada(So) = So, Foadada (81) = Sos FoadaddlS2) = So 
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and the same formulas hold for f,44 ° fyaq. In fact, 


(fada° Foaa) So) = Fada’ Sraa(So)) = faaalS1) = So 
(fada ° Soaa) (81) = foal Srad(1)) = foaals1) = Sq 
(faaa ° foaa) (82) = faaal Soaa(S2)) = fraalS1) = Soe ° 


Example 4. Consider the machine whose graph is shown in Figure 10.35. Show 
that f,,(so) = s) if and only if w has 3n 1’s for some n = 0. 


0 0 


Figure 10.35 


Solution: From Figure 10.35 we see that f, = 1,,so0 the 0’s in a string w € /* 
have no effect on f,,. Thus, if w is w with all 0’s removed, then f, = f;. Let 
1(w) denote the length of w, that is, the number of digits in w. Then /() is 
the number of 1’s in w, for all w € /*. For each n = 0, consider the state- 
ment 


P(n) : Let w € I* and let [(w) = m. 
(a) Ifm = 3n, then f,,(s9) = Sp. 
(b) Ifm = 3n + 1, then f,,(59) = 5}. 
(c) Ifm = 3n + 2, then f,,(59) = 5. 


We prove by mathematical induction that P(x) is true for all n = 0. 


BAsIs STEP, Suppose that n = 0. In case (a), m = 0; therefore, w has no 1’s 
and f,(59) = 1s(8o) = 5p. In case (b), m = 1,so w = 1 and f,(s9) = fg (s)= 
Ff, (89) = s,. Finally, in case (c),m = 2,80 w = 


11, and F059) = fr(So) = fir) = Ay) = 5. 


INDUCTION STEP. We must show that P(k) — P(k + 1) is always true. 
Suppose that P(k) is true for some k = 0. Let w € /*, and denote /(w) by 
m. In case (a), m = 3(k + 1) = 3k + 3; therefore, w = w’ + 111, 
where /(w’) = 3k. Then f,,(s)) = 59 by the induction hypothesis, and 
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Fis) = Sq by direct computation, so f5 (5) = fur(fio)) = f(So) = So- 
Cases (b) and (c) are handled in the same way. Thus P(k + 1) is true. 


By mathematical induction, P(n) is true for all n = 0, so f,,(5p) = Sp if and 
only if the number of 1’s in w is a multiple of 3. 


Suppose now that (5S, I. ¥, ij, T) is a Moore machine. As in Section 10.1, we 
may think of certain subsets of /* as “languages” with “words” from J. Using M, 
we can define such a subset, which we will denote by L(M), and call the language 
of the machine M. Define L(V) to be the set of all w € I* such that f,(sy) € T. 
In other words, L(M) consists of all strings that, when used as input to the 
machine, cause the starting state: sy to move to an acceptance state in T. Thus, in 
this sense, M accepts the string. It is for this reason that the states in T were 
named acceptance states in Section 10.3. 


Example 5. Let M = (S, I, ¥, 59, T) be the Moore machine in which (S, J, ¥) is 
the finite-state machine whose digraph is shown in Figure 10.35, and T = {s,}. The 
discussion of Example 4 shows that f,,(s,) = s, if and only if the number of 1’s in 
w is of the form 3” + 1 for some x = 0. Thus L(M) is exactly the set of all strings 
with 3n + 1 1’s for some v# 2 0). 6d 


Example 6. Consider the Moore machine M whose digraph is shown in Figure 
10.36. Here state sy is the starting state, and T = {s,}. What is L(M)? Clearly, the 
input set is J = {a, b}. Observe that, in order for a string w to cause a transition 
from Sp to S,, w must contain at least two b’s. After reaching s,, any additional let- 
ters have no effect. Thus L(M) is the set of all strings having two or more b’s. We 
see, for example, that fiayaa(So) = 51, 80 aabaa is rejected. On the other hand, 
Fabaab’So) = 5, 80 abaab is accepted. 


a a a,b 


Figure 10.36 
In Exercises 1 through 5, we refer to the finite- 1. List the values of the transition function f,, for 
state machine whose state transition table is w = 01001. 


2. List the values of the transition function f, for 
w = 11100. 


3. Describe the set of binary words (sequences 
of 0’s and 1’s) w having the property that 
FlS0) = So: 


4. Describe the set of binary words w having the 
property that f,, = foro. 


§. Describe the set of binary words w having the 
property that f,,(s9) = 52. 


In Exercises 6 through 10, we refer to the finite- 
state machine whose digraph is shown in Figure 
10.37. 


Figure 10.37 


6. List the values of the transition function f, for 
w = abba. 


7. List the values of the transition function f,, for 
w = babab. 

8. Describe the set of words w having the property 

that f,(so) = 52. 


9. Describe the set of words w having the property 
that f, (so) = 5p. 


Figure 10.38 
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10. Describe the set of words w having the property 
that fv = Sova 


11. Describe the language accepted by the Moore 
machine whose digraph is shown in Figure 10.38. 


In Exercises 12 through 15, describe (in words) 
the language accepted by the Moore machines 
whose digraphs are given in Figures 10.39 
through 10.42. 


Figure 10.42 : 
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16, Describe the language accepted by the Moore 
machine whose state table is shown if T = {s,} 
and sy is the starting state. 


So Sy Sz 
5 5 52 
$5 Sy Sy 


In Exercises 17 and 18, describe (in words) the 
language accepted by the Moore machines 
whose state tables are given. The starting state is 
So, and the set T of acceptance states is shown. 


17. 


T = {s} 


18. 


T = {s,} 


Sy So sy 


19. Describe the language accepted by the Moore 
machine whose state table is given. The starting 
State is s) and the set of acceptance states T is 


{s2}. 


So Sy S354 
Sy Sq Sy Sy 
Sy S4 Sy 54 
53 Sq Sy Sy 
Sq Sq Sy Sy 


20. Let M = {S, 1, ¥, sy, T} be a Moore machine. 
Suppose that ifs © T and w € /*, then 
f,(s) © T. Prove that L(M) is a subsemigroup 
of (/*, -), where - is catenation. 


10.5. Machines and Regular Languages 


Let M = (S, 1, ¥, 89, T) be a Moore machine. In Section 10.4 we defined the lan- 
guage L(M) of the machine WV’ It is natural to ask if there is a connection 
between such a language and the languages of phrase structure grammars, dis- 
cussed in Section 10.1. The following theorem, due to S. Kleene, describes the 


connection. 


Theorem 1. Let I be a set and let L ¢ I*. Then L is a type 3 language; that is, 
L = L(G), where G is a type 3 grammar having 1 as its set of terminal symbols, if 


and only if L = L(M) for some Moore machine M = (S,1, ¥, 89, T). 


od 


We stated in Section 10.2 that a set L € /* is a type 3 language if and only 
if L is a regular set, that is, if aud only if L corresponds to some regular expres- 
sion over J. This leads to the following corollary of Theorem 1. 


Corollary 1. Let I be a set and let L C I*. Then L = L(M) for some Moore 


machine M = (S,1, #, 89, T) if end only if L is a regular set. 


° 


We will not give a complet: and detailed proof of Theorem 1. However, it 
is easy to give a construction that produces a type 3 grammar from a given Moore 
machine. This is done in such a way that the grammar and the machine have the 
same language. Let M = (S, /, 9, 5, T) be a given Moore machine. We construct 
a type 3 grammar G = (V,/, 5, —») as follows. Let V = I U S; that is, J will be the 
set of terminal symbols for G, while S will be the set of nonterminal symbols. Let 
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s,and s; be in S, and x € J. We write 5; xs,, if f,(s,) = 5, that is, if the input x takes 
state s; tos, We also write s;+> x if f,(s,) € T, that is, if the input x takes the state 
s; 10 some acceptance state. Now let + be the relation determined by the two 
conditions above and take this relation as the production relation of G. 

The grammar G constructed above has the same language as M. Suppose, 
for example, that w = x,x,x, € I*. The string w is in L(M) if and only if f,,(s9) = 
fax Fg Jns(5,))) © T: Let a = f,(5), = fag(@), and c = f,,(b), where ¢ = f(50) is 
in 7. Then the rules given above for constructing +> tell us that 


1. spre xa 
2. a> Xb 
3. bre x; 


are all productions in G. The last one occurs because c € T. If we begin with sy 
and substitute, using (1), (2), and (3) in succession, we see that sy =>* x,x,x, = w 
(see Section 10.1), so w € L(G). A similar argument works for any string in 
L(M), so L(M) C L(G). If we reverse the argument given above, we can see that 
we also have L(G) C L(M). Thus M and G have the same language. 


Example 1. Consider the Moore machine M shown in Figure 10.36. Construct a 
type 3 grammar G such that L(G) = L(M). Also, find a regular expression over 
I = {a, b) that corresponds to L(M). 


Solution: Let I = {a, b}, S = {59, 5,, 8), and V = I U S. We construct the 
grammar (V, J, sy, +), where + is described as follows: 


>t Syh>dSy 5+ Dy 
Syt> bs, S,t>b 
S$, > as, S,'> a 


5, +> Ds Sob 
Sy > 5, 


The production relation + is constructed as we indicated previously; there- 
fore, L(M) = L(G). 

If we consult Figure 10.36, we see that a string w € L(M) has the fol- 
lowing properties. Any number n = 0 of a’s can occur at the beginning of w. 
At some point, a b must occur in order to cause the transition from Sy to 5}. 
After this b, any number k = 0 of a’s may occur, followed by another b to 
cause transition to s,. The remainder of w, if any, is completely arbitrary, 
since the machine cannot leave s, after once entering this state. From this 
description we can readily see that L(M) corresponds to the regular expres- 
sion 


a*ba*b(a V b)*. o 


Example 2. Consider the Moore machine whose digraph is shown in Figure 
10.43. Describe in English the language L(M).Then construct the regular expres- 
sion that corresponds to L(M) and describe the productions of the correspond- 
ing grammar G in BNF form. 
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0 0 
( ) ——_.(. 
Figure 10.43 


Solution: It is clear that C’s in the input string have no effect on the states. 
If an input string w has an odd number of 1’s, then f,,(s)) = s). If w has an 
even number of 1’s, then f,,(s9) = So. Since T = {s,}, we see that L(M) con- 
sists of all w in /* that have an odd number of 1’s as components. 

We now find the regular expression corresponding to L(M). Any input 
string corresponding to the expression 0*10* will be accepted, since it will 
have exactly one 1. [f an input w begins in this way, but has more 1’s, then 
the additional ones must come in pairs, with any number of 0’s allowed 
between, or after each pair of 1’s. The previous sentence describes the set of 
strings corresponding to the expression (10*10*)*. Thus L(M) corresponds 
to the regular expression 


0*10*(10*10*)*. 


Finally, the type 3 gramraar constructed from M is G = (V, J, s),+~) with 
V =1US.The BNF of the relation +> is 


(59) 1 = O{sq) | 1¢s;) | 1 
(54) 1 = Ofs,) | 1¢s,) | 0. 5 


Occasionally, we may need to determine the function performed by a given 
Moore machine, as we did in the examples above. More commonly, however, it is 
necessary to construct a machine that will perform a given task. This task may be 
defined by giving an ordinary English description, a regular expression, or an 
equivalent type 3 grammar, perhaps in BNF or with a syntax diagram. There are 
systematic, almost mechanical ways to construct such a machine. Most of these 
use the concept of nondeterministic machines and employ a tedious translation 
process from such machines to t1 Moore machines that we have discussed. If the 
task of the machine is not too complex, we may use simple reasoning to construct 
the machine in steps, usually in the form of its digraph. Whichever method is 
used, the resulting machine may be quite inefficient; for example, it may have 
unneeded states. In Section 10.6, we will give a procedure for constructing an 
equivalent machine that may be inuch more efficient. 


Example 3. Construct a Moore machine M that will accept exactly the string 
001 from input strings of 0’s and 1’s. In other words, J = {0,1} and L(M) = {001}. 


Solution: We must begin with a starting state so. If w is an input string of 
0’s and 1’s and if w begins with a 0, then w may be accepted (depending on 
the remainder of its components). Thus one step toward acceptance has 
been taken, and there needs to be a state s, that corresponds to this step. 
We therefore begin as in Figure 10.44(a). If we next receive another 0, we 
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have progressed one more step toward acceptance. We therefore construct 
another state s, and let 0 give a transition from s, to s,. State s, represents 
the condition “first component of input is a 0,” whereas state s, represents 
the condition “first two components of the input are 00.” This situation is 
shown in Figure 10.44(b). Finally, if the third input component is a 1, we 
move to an acceptance state, as shown in Figure 10.44(c). Any other begin- 
ning sequence of input digits or any additional digits will move us to a “fail- 
ure state” s, from which there is no escape. Thus Figure 10.44(d) shows the 
completed machine. a 


(a) 


@)}H)H-@Q++@&) © 
(c) 


Figure 10.44 


(d) 


The process illustrated in Example 3 is difficult to describe precisely or to 
generalize. We try to construct states representing each successive stage of input 
complexity leading up to an acceptable string. There must also be states indicat- 
ing the ways in which a promising input pattern may be destroyed when a certain 
component is received. If the machine is to recognize several, essentially differ- 
ent types of input, then we will need to construct separate branches correspond- 
ing to each type of input. This process may result in some redundancy, but the 
machine can be simplified later. 


Example 4. Let J = {0, 1}. Construct a Moore machine that accepts those input 
sequences w that contain the string 01 or the string 10 anywhere within them. In 
other words, we are to accept exactly those strings that do not consist entirely of 
0’s or entirely of 1’s. 


Solution: This is a simple example in which, whatever input digit is 
received first, a string will be accepted if and only if the other digit is even- 
tually received. There must be a starting state sj, states s; and s, corre- 
sponding respectively to first receiving a 0 or 1, and (acceptance) states s, 
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and s,, which will be reached if and when the other digit is received. Having 
once reached an acceptance state, the machine stays in that state. Thus we 
construct the digraph of this machine as shown in Figure 10.45. Sd 


@ ay 
+ 


0, 1 


Figure 10.45 


In Example 3, once an acceptance state is reached, any additional input will 
cause a permanent transition 10 a nonaccepting state. In Example 4, once an 
acceptance state is reached, any additional input will have no effect. Sometimes 
the situation is between these two extremes. As input is received, the machine 
may repeatedly enter and leave acceptance states. Consider the Moore machine 
M whose digraph is shown in Figure 10.46. This machine is a slight modification 
of the finite-state machine given in Example 4 of Section 10.4. We know from that 
example that w € L(M) if and only if the number of 1’s in w is of the form 3n, 


Figure 10.46 
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n = 0. As input components are received, M may enter and leave s, repeatedly. 
The conceptual states “one 1 has been received” and “four 1’s have been 
received” may both be represented by s,. When constructing machines, we should 
keep in mind the fact that a state, previously defined to represent one conceptual 
input condition, may be used for a new input condition if these two conditions 
represent the same degree of progress of the input stream toward acceptance. 
The next example illustrates this fact. 


Example 5. Construct a Moore machine that accepts exactly those input strings 
of x’s and y’s that end in yy. 


Solution: Again we need a starting state so. If the input string begins with 
a y, We progress one step to a new state s, (“last input component received 
is ay”). On the other hand, if the input begins with an x, we have made no 
progress toward acceptance. Thus we may suppose that M is again in state 
So This situation is shown in Figure 10.47(a). If, while in state s,, a y is 
received, we progress to an acceptance state s, (“last two components of 
input received were y’s”). If instead the input received is an x, we must 
again receive two y’s in order to be in an acceptance state. Thus we may 
again regard this as a return to state s,. The situation at this point is shown 
in Figure 10.47(b). Having reached state s,, an additional input of y will 
have no effect, but an input of x will necessitate two more y’s for accep- 
tance. Thus we can again regard M as being in state 5). The final Moore 
machine is shown in Figure 10.47(c). o 


Figure 10.47 


We have not mentioned the question of implementation of finite-state 
machines. Indeed, many such machines, including all digital computers, are imple- 
mented as hardware devices, that is, as electronic circuitry. There are, however, 


410 


Chapter 10 


Languages and Finite-State Machines 


many occasions when finite-state machines are simulated in software. This is fre- 
quently seen in compilers and interpreters, for which Moore machines may be 
programmed to retrieve and in-erpret words and symbols in an input string. We 
provide just a hint of the techniques available by simulating the machine of 
Example 2 in pseudocode. The reader should refer back to Example 2 and Figure 
10.43 for the details of the machine. The following subroutine gives a pseudocode 
program for this machine. 

This program uses a subroutine INPUT to get the next 0 or 1 in variable Y 
and assumes that a logical variable EO{ will be set true when no further input is 
available. The variable RESULT will be true if the input string contains an odd 
number of 1’s; otherwise, it will be false. 


SUBROUTINE ODDONES (RESULT) 
1. EOC F 
2. RESULT ¢ F 
3. STATE < 0 
4. UNTIL (EOT) 
a. CALL INPUT (X, EOI) 
1. IF (EOI = F) THEN 
a. IF (STATE = 0) THEN 
1. IF (X = 1) THEN 
a. RESULT — T 
b. STATE «1 
b. ELSE 
1. IF (X = 1) THEN 
a. RESULT ¢- F 
b. STATE < 0 
5. RETURN 
END OF SUBROUTINE ODDONES 


In this particular coding technique, a state is denoted by a variable that may 
be assigned different values depending on input, and whose values then deter- 
mine other effects of the input. An alternative procedure is to represent a state 
by a particular location in code. This location then determines the effect of input 
and the branch to a new location (subsequent state). The following subroutine 
shows the same subroutine ODDONES coded in this alternative way. 


SUBROUTINE ODDONE'S (RESULT) version 2 
1. RESULT & F 
S0: 2. CALL INPUT (X, EOI) 
3, IF (EOI) THEN 
a. RETURN 
4. ELSE 
a. IF (X = 1) THEN 
1. RESULT <— 7° 
2.GOTO S1 
b. ELSE 
1. GOTO SO 
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$1; 5. CALL INPUT (X, EOD 
6. IF (EOI) THEN 
a. RETURN 
7. ELSE 
a. IF (X = 1) THEN 
1. RESULT «+ F 
2. GOTO SO 
b. ELSE 
1. GOTO S1 
END OF SUBROUTINE ODDONES version 2 


It is awkward to avoid GO TO statements in this approach, and we have 
used them. In languages with multiple GO TO statements, such as FORTRAN’s 
indexed GO TO or PASCAL’s CASE statement, this method may be particularly 
efficient for finite-state machines with a fairly large number of states. In such 
cases, the first method may become quite cumbersome. 


EXERCISE SET 10.5 


1. Let M be the Moore machine of Figure 10.48. 
Construct a type 3 grammar G = (V, J, 5, >), 
such that L(M) = L(G). 


0 0 


Figure 10.49 


4, Let M be the Moore machine of Figure 10.50. 
Construct a type 3 grammar G = (V, J, 59,+>), 
such that L(M) = L(G). Describe +> in BNF. 


Figure 10.50 
Figure 10.48 
: 5. Let M be the Moore machine of Figure 10.51. 
2. Let M be the Moore machine of Figure 10.49. Construct a type 3 grammar G = (V,1,59,>), 
Give a regular expression over J = {0, 1}, which such that L(M) = L(G). Describe + in BNE 


corresponds to the language L(). 
. 6. Let M be the Moore machine of Exercise 17, 
3. Let M be the Moore machine of Exercise 18, Section 10.4. Construct a type 3 grammar 


Section 10.4. Give a regular expression over / = G = (V,1, 59,4), such that L(M) = L(G). 
{0, 1}, which corresponds to the language L(M). Describe +> by a syntax diagram. 
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Figure 10.51 


In Exercises 7 through 20, construct the digraph 
of a Moore machine that accepts the input 
strings described and no others. 


7. 


8 


11. 


5B 


17. 


10.6. Simplification of Machines 


Inputs a, b: strings where the number of b’s is 
divisible by 3. 


Inputs a, b: strings where the number of a’s is 
even and the number of b’s is a multiple of 3. 


Inputs x, y: strings that have an even number of 
y’s. 


Inputs 0, 1: strings that contain 0011. 
Inputs 0, 1: strings that end with 0011. 
Inputs O, A: strings that contain DA or AD. 


Inputs +, X:strings that contain + X X or 
x ++4. 


Inputs w, z: strings that contain wz or zzw. 


Inputs a, b: strings that contain ab and end in 
bbb. 


Inputs +, X: strings that end in + X Xx, 


Inputs w, z: strings that end in wz or zzw. 


18. Inputs 0, 1, 2: string 0120 is the only string rec- 
ognized. 


19. Inputs a, b, c: strings aab or abc are to be recog- 
nized. 


20. Inputs x, y, z: strings xzx or yx or zyx are to be 
recognized. 


In Exercises 21 through 25, construct the state 
table of a Moore machine that recognizes the 
given input strings and no others. 


21. Inputs 0, 1: strings ending in 0101. 


22. Inputs a, b: strings where the number of b’s is 
divisible by 4. 


23. Inputs x, y: strings having exactly two x’s. 


24. Inputs a, b: strings that do not have two succes- 
sive b’s. 


25. Let M = (S, I, ¥, 5, T) be a Moore machine. 
Define a relation R on S as follows: s; R s, if and 
only if f,(s;) and f,(s,) either both belong to T 
or neither does, for every w € /*. Show that R 
is an equivalence relation on S. 


As we have seen, the method in Section 10.5 for the construction of a finite-state 
machine to perform a given task is as much an art as a science, Generally, graph- 
ical methods are first used, and states are constructed for all intermediate steps 
in the process. Not surprisingly, a machine constructed in this way may not be 
efficient, and we need to find a inethod for obtaining an equivalent, more effi- 
cient machine. Fortunately, a method is available that is systematic (and can even 
be computerized), and this method will take any correct machine, however 
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redundant it is, and produce an equivalent machine that is usually more efficient. 
Here we will use the number of states as our measure of efficiency. We will 
demonstrate this technique for Moore machines, but the principles extend, with 
small changes, to various other types of finite-state machines. Let (S, 1, ¥, 59, T) 
be a Moore machine. We define a relation R on S as follows: For any s,t € S and 
w & I*, we say that s and ¢ are w-compatible if f,(s) and f,(¢) both belong to T, 
or neither does. Let s R ¢ mean that s and ¢ are w-compatible for all w € J*. 


Theorem 1. Let (S, I, ¥, 5), T) be a Moore machine, and let R be the relation 
defined above. 

(a) R is an equivalence relation on S. 

(b) R is a machine congruence (see Section 10.3). 


Proof: (a) R is clearly reflexive and symmetric. Suppose now that s R t and 
tRu fors,t,and win S, and let w € J*. Then s and t are w-compatible, as are 
t and u, so if we consider f,,(s), f(t), f,(u), it follows that either all belong 
to T or all belong to T, the complement of 7. Thus s and u are w-compati- 
ble, so R is transitive, and therefore R is an equivalence relation. 

(b) We must show that if s and tare in S and x € J, then s R t implies that 
fs) Rf,(t). To show this, let w € J*, and let w’ = w+ x (- is the operation of 
catenation). Since s R t, f,(s) and f,(t) are both in T or both in T. But 
fulS) = fy x3) = FACS) and f,(0) = fx) = fu FO), so f(s) and fA) 


are w-compatible. Since w is arbitrary in I*, f(s) R f,(2). 


Since R is a machine congruence, we may form the quotient Moore 
machine M = (S/R, 1, ¥, [sp], T/R) as in Section 10.3. The machine M is the effi- 
cient version of M that we have promised. We will show that M is equivalent to 
M, meaning that L(M) = L(M). 


Example 1. Consider the Moore machine whose digraph is shown in Figure 
10.52. In this machine J = {0, 1}. The starting state is sy, and T = {s,, s,}. Let us 
compute the quotient machine M. First, we see that s) R s,. In fact, f(s) & T 
if and only if w contains at least one 1, and f,(s,) © T under precisely the same 
condition. Thus s) and s, are w-compatible for all w € I*, Now s, R sy and 
53 R so, since fi(s,) & T, fo(s3) © T, but fo(so) € T. This implies that {s9, 5,} is one 
R-equivalence class. Also s, R s3, since f(s) € T and f,(s,) & I for all w € I*. This 
proves that 


SIR = {{5q, 51}, (82, 53}} = {[5o], [s2]}. 


Also note that 7/R = {{s,]}. The resulting quotient Moore machine M is equiva- 
lent to M and its digraph is shown in Figure 10.53. 


In this case it is clear that M and M are equivalent since each accepts a word 
w if and only if w has at least one 1. In general, we have the following result. 


Theorem 2. Let M = (S,1,%,59, T) be a Moore machine, let R be the equivalence 
relation defined above, and let M = (SIR, I, , [so], T/R) be the corresponding quo- 
tient Moore machine. Then L(M) = L(M). 
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Figure 10.52 Figure 10.53 


Proof: Suppose that w is accepted by M so that f,(s)) © T. Then f,,([sy]) = 
[f,(8o)] © TIR; that is, M also accepts w. 

Conversely, suppose that M accepts w so that f,,([59]) = [f,(s)] is in T/R. 
This means that ¢ R f,(so) ‘or some element ¢ in T. By definition of R, we 
know that ¢ and f,,(so) are #’-compatible for every w’ € I*, If w’ = A, the 
empty string, then f,, = 1,,so¢ = f,(t) and f,(so) = f,,(f,(5o)) are both in T 
or both in T. Since t € T, we must have f,(s,) © T,so M accepts w. Sd 


Thus we see that after initially designing the Moore machine M, we may 
compute R and pass to the quotient machine M = M/R, thereby obtaining an 
equivalent machine that may be considerably more efficient, in the sense that it 
may have many fewer states. Often the quotient machine is one that would have 
been difficult to discover at the cutset. 

We now need an algorithm for computing the relation R. In Example 1 we 
found R by direct analysis of input, but this example was chosen to be particu- 
larly simple. In general, a direct analysis will be very difficult. We now define and 
investigate a set of relations that provides an effective method for computing R. 

If k is a nonnegative integer, we define a relation R, on S, the state set of a 
Moore machine (S, 1, ¥, 59, 7). If w € J*, recall that /(w) is the length of the string 
w, that is, the number of symbols in w. Note that /(A) = 0. Then, if s and f € S, we 
let s R, t mean that s and ¢ are w-compatible for all w © I* with /(w) < k. The 
relations R, are not machine congruences, but are successive approximations to 
the congruence R. 


Theorem 3 
(a) R,4, CR, forallk = 0. 
(b) Each R, is an equivalence relation. 
(c) RCR, for allk = 0. 


Proof: ITfs,t © S,and s and ¢ are w-compatible for all w € J* or for all w 
with /(w) = k + 1, then in either case s and f are compatible for all w with 
I(w) = k. This proves parts (a) and (c). The proof of part (b) is similar to the 
proof of Theorem 1(a), and we omit it. od 
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The key result for computing the relations R, recursively is the following 
theorem. 


Theorem 4 
(a) S/R, = {T,T}, whereT is the complement of T. 
(b) Let k be a nonnegative integer and s,t € S. Then s R,,, tif and only if 
(1) sR, t. 
(2) f(s) Ry ff for allx EL. 


Proof: (a) Since only A has length 0, it follows that s Ry ¢ if and only if 
both s and ¢ are in T or both are in 7. This proves that S/Ry = {T,T}. 

(b) Let w € J* be such that /(w) = & + 1. Then w = w’ : x, for some 
x € Jand for some w’ & J* with [(w’) = k. 

Conversely, if any x © J and w’ € I* with /(w’) = k are chosen, the result- 
ing string w = w’ - x has length less than or equal to k + 1. 

Now f(s) = fy (8) = ffs) and f,(8) = fC fi(0) for any s, tin S.- 
This shows that s and ¢ are w-compatible for any w € /* with /(w) = 
k + 1if and only if f,(s) and f,(¢) are, for all x € J, w’-compatible, for any 
w’ with [(w’) = k. That is, s R,,,¢ if and only if f(s) R, f,(@) for all 


xEL 
Now either of these equivalent conditions implies that s R, t, since 
Ry, C R,, 80 we have proved the theorem. Sd 


This result says that we may find the partitions P,, corresponding to the 
relations R,, by the following recursive method: 


STEP 1. Begin with P, = {T,T}. 


STEP 2. Having reached partition P, = {A,, A>,...,A,,}, examine each equiva- 
lence class A, and break it into pieces where two elements s and ¢ of A; fall into 
the same piece if all inputs x take both s and ¢ into the same subset A, (depend- 
ing on x). 


STEP 3. The new partition of S, obtained by taking all pieces of all the A,, will be 
P k+t 


The final step in the method above, telling us when to stop, is given by the 
following result. 


Theorem 5. If R, = R;,, for any nonnegative integer k, then R, = R. 


Proof: Suppose that R, = R,,,.Then, by Theorem 4,5 R, ,,. tif and only 
if f,(s) Rei: f,( for all x © J, or (since R, = R,,,) if and only if 
f(s) R, f,@ for all x € £. This happens if and only ifs R,,,, 4 Thus Ry, = 
R,.., = R,. By induction, it follows that R, = R, for alln = k. Now it is easy 
to see that R = M5.) R,, since every string w in /* must have some finite 
length. Since R, D R,--- DR, = R,,; = +++, the intersection of the R,’s is 
exactly R,,so R = R,. 


A procedure for reducing a given Moore machine to an equivalent machine 
is as follows. 
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STEP 1. Start with the partition P, = {T,T} of S. 


STEP 2. Construct successive partitions P,, P,,... corresponding to the equiva- 
lence relations R,, R,,... by using the method outlined after Theorem 4. 


STEP 3. Whenever P, = P,,),Slop. The resulting partition P = P, corresponds to 
the relation R. 


Step 4, The resulting quotient machine is equivalent to the given Moore 
machine. 


Example 2. Consider the machine of Example 1. Here S = {sq, s,, 55, 53} and 
T = {s, s,}. We use the methad above to compute an equivalent quotient 
machine. First, P) = {{5), 5}, (82, 83}}. We must decompose this partition in order 
to find P,. Consider first the set {s,, s,}. Input 0 takes each of these states into 
{s, 5,}. Input 1 takes both sy and 5, into {s,, s,}. Thus the equivalence class {sp, s,} 
does not decompose in passing to P,. We also see that input 0 takes both s, and 
5, into {s,,5,}, and input 1 takes both s, and s, into {s,, s,}. Again, the equivalence 
class {s,, 5,} does not decompose in passing to P,. This means that P, = Py, so Py 
corresponds to the congruence &. We found this result directly in Example 1. # 


Example 3. Let M be the Moore machine shown in Figure 10.54. Find the rela- 
tion R and draw the digraph of the corresponding quotient machine M. 


Solution: The partition P, = {T,T} = {{s9. 55}, (81, 59, 83) 84}}. Consider first 
the set {s9, 5}. Input 0 carries both s, and s, into T, and input 1 carries both 
into T . Thus {59, 55} does not decompose further in passing to P;. Next con- 
sider the set T = {5,,55, 54,%,|. State s, is carried to T by input 0 and to T by 
input 1. This is also true for state s,, but not for s, and s,; so the equivalence 
class of s, in P, will be {s,, «,}. Since states s, and s, are carried into T by 
inputs 0 and 1, they will also form an equivalence class in P,. Thus T has 
decomposed into the subsets {s,, s,} and {s,, s,} in passing to P,, and P,; = 
{{50, Ss}, {51,54}, {52,53}. 


0 
Figure 10.54 Figure 10.55 
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To find P,, we must examine each subset of P, in turn. Consider 
{5o, Ss}. Input 0 takes 5) and 5s, to {so, 5s}, and input 1 takes each of them to 
{s,, 54}. This means that {so,5;} does not further decompose in passing to P). 
A similar argument shows that neither of the sets {s,,5,} and {s,,5;} decom- 
poses, so that P, = P,. Hence P, corresponds to R. The resulting quotient 
machine is shown in Figure 10.55. It can be shown (we omit the proof) that 
each of these machines will accept a string w = b,b, --- b, in {0, 1}* if and 
only if w is the binary representation of a number that is divisible by 3. @ 


EXERCISE SET 10.6 


In Exercises 1 through 8, find the specified rela- 6. Find R,. 
tion R, for the Moore machine whose digraph is 
given. 


1, Find R,. 


Figure 10.56 


Figure 10.58 


2. Find R, for the Moore machine depicted by 


Figure 10.56 7. Find R, for the machine of Exercise 6. 


8. Find R, for the Moore machine whose digraph 


3. Find R,. 
a is given in Figure 10.60 on page 418. 


9. Find R for the machine of Exercise 1. 
10. Find R for the machine of Exercise 3. 


11, Find R for the machine of Exercise 6. 


12. Find R for the Moore machine whose digraph is 
given in Figure 10.59. 


Figure 10.57 


4, Find R, for the machine of Exercise 3. 


5. Find Rj, for the machine of Exercise 3. Figure 10.59 
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KEY IDEAS FOR REVIEW 
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Phrase structure grammar: see page 370 
Production: a statement w ~~ w’, where 
(wew’) Er 

Direct derivability: see page 370 

Terminal symbols: the elements of S$ 
Nonterminal symbols: the elements of V — S$ 
Derivation of a sentence: substitution process 
that produces a valid sentence 

Language of a grammar G: set of all properly 
constructed sentences that can be produced 
from G 

Derivation tree for a sentence: see page 373 
Types 0, 1, 2,3 phrase structure grammars: see 
page 376 

Context-free grammar: type 2 grammar 
Regular grammar: type 3 grammar 

Parsing: process of obtaining a derivation tree 
that will produce a given sentence 
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In Exercises 13 and 14, find the partition corre- 
sponding to the relation R,and construct the state 
table of the corresponding quotient machine that 
is equivalent to the Moore machine whose state 
table is shown. 


1, a 1 


WAR AA STA 
TF A AAR A 


. Find the relation R and construct the digraph of 
the corresponding equivalent quotient machine 
for the Moore machine whose digraph is shown 
in Figure 10.60. 


BNF notation: see page 378 

Syntax diagram: see page 381 

Theorem: Let S be a finite set, and L C S*. 
Then Z is a regular set if and only if L = L(G) 
for some regular grammar G = (V, S, vg, +>). 
Finite-state machine: (S, J, ¥), where S is a 
finite set of states, J is a set of inputs, and 
H=(f.|xel} 

State transition table: see page 391 

Ry: 8; Ry 5; if there is an input x so that 
FAS) = 5; 

Moore machine: M = (S, I, ¥, s,, T), where 
wo © Sis the starting state and T C S is the set 
of acceptance states 

Machine congruence R on M: For any s,t & S, 
s Rtimplies that f(s) R f.() for all x € I. 
Quotient of M corresponding to R: see page 
394 


¢ State transition function f,, w= x2) °° °X,! 
Fu = fan °Fan—1 2 Fee fa = Ms 

@ Theorem: Let M = (5S, I, &) be a finite-state 
machine. Define T : [* — S° by T(w) = f,, w # 
A, and T(A) = 15. Then 
(a) If w, and w, are in J*, then T(w, - 

T(w,) o Tim). 

(b) If 4 = T(J*), then is a submonoid of S*. 

# Monoid of a machine: Al in the preceding 
theorem. 


W,) = 


CODING EXERCISES 


For each of the following, write the requested pro- 
gram or subroutine in pseudocode (as described in 
Appendix A) or in a programming language that 
you know. Test your code either with a paper-and- 
pencil trace or with a computer run. 


1. Let M = (S, I, ) be a finite-state machine 
where S = {s9,s,},/ = {0,1}, and # is given by 
the following state transition table. 


0 1 
So So Sy 
Sy Sy So 


Write a subroutine that, given a state and an 
input, returns the next state of the machine. 


2. Write a function ST_TRANS that takes a 
word w, a string of 0’s and 1’s, and a state s 
and returns f,(s), the state transition function 
corresponding to w evaluated at s. 
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@-compatible: see page 413 

Equivalent machines M and N: L(M) = L(N) 
i(w): length of the string w 

Language accepted by M: L(M) = 

(w ET f,(59) € 7) 

Theorem: Let J be a set and L C J*, Then Lisa 
type 3 language, that is, L = L(G) if and only if 
L = L(M) for some Moore machine M. 


eee 


Sd 


3. Let M = (S, I, ¥, T) be a Moore machine 
where S = {5p, 51, 5}, 7 = {0,1}, T = {s,}, and 
# is given by the following state transition 
table. 


So So Ss] 
sy So S2 
Sy Sy So 


Write a program that determines if a given 
word w is in L(M). 


4. Write a subroutine that simulates the Moore 
machine given in Exercise 2, Section 10.5. 


5. Write a subroutine that simulates the Moore 
machine given in Exercise 4, Section 10.5. 
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In today’s modern world of communication, data items are constantly being 
transmitted from point to point. This transmission may range from the simple 
task of a computer terminal interacting with the mainframe computer located 
200 feet away, to the more complicated task of sending a signal thousands of 
miles away via a satellite that is parked in an orbit 20,000 miles from the earth, 
or to a telephone call or letter to another part of the country. The basic problem 
in transmission of data is that of receiving the data as sent and not receiving a dis- 
torted piece of data. Distortion can be caused by a number of factors. 

Coding theory has developed techniques for introducing redundant infor- 
mation in transmitted data that help in detecting, and sometimes in correcting, 
errors. Some of these techniques make use of group theory. We present a brief 
introduction to these ideas in this chapter. 
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11.1. Coding of Binary Information and 
Error Detection 


The basic unit of information, called a message, is a finite sequence of characters 
from a finite alphabet. We shall choose our alphabet as the set B = {0, 1}. Every 
character or symbol that we want to transmit is now represented as a sequence of 
m elements from B. That is, every character or symbol is represented in binary 
form. Our basic unit of information, called a word, is a sequence of m 0’s and 1’s. 

The set B is a group under the binary operation + whose table is shown in 
Table 11.1. See Example 5 of Section 9.4.) If we think of B as the group Z,, then + 
is merely mod 2 addition. It follows from Theorem 1 of Section 9.5 that 


Table 11.1 
+|/0 1 
ojo 1 
1] 1 0 


B”" = BX BX---X B (m factors) is a group under the operation @ defined by 


(45% +++ Xm) BD (Vis Yar -+ + Yn) = (x + Vy XQ t Yar++ +3 Xm + Yn) 


This group has been introduced in Example 2 of Section 9.5. Its identity is 0 = 
(0, 0,..., 0) and every element is its own inverse. An element in B” will be writ- 
ten as (b,, b5,...,5,,) or more simply as b,5, --: b,,. Observe that B” has 2” ele- 
ments. That is, the order of the group B” is 2”. 

Figure 11.1 shows the basic process of sending a word from one point to 
another point over a transmission channel. An element x € B” is sent through 
the transmission channel and is received as an element x, € B”. In actual prac- 
tice, the transmission channel may suffer disturbances, which are generally called 
noise, due to weather interference, electrical problems, and so on, that may cause 
a 0 to be received as a 1, or vice versa. This erroneous transmission of digits in a 
word being sent may give rise to the situation where the word received is differ- 
ent from the word that was sent; that is, x # x, If an error does occur, then x, could 
be any element of B”. 


Word Word 


x € B™ x, © B™ 


Transmission channel 


transmitted received 


Figure 11.1 


The basic task in the transmission of information is to reduce the likelihood 
of receiving a word that differs from the word that was sent. This is done as fol- 
lows. We first choose an integer n > m and a one-to-one function e : B” > B’. 
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The function e¢ is called an (m,n) encoding function, and we view it as a means of 
representing every word in B” as a word in B”. If b © B”, then e(b) is called the 
code word representing b. The additional 0’s and 1’s can provide the means to 
detect or correct errors produced in the transmission channel. 

We now transmit the code words by means of a transmission channel. Then 
each code word x = e(b) is received as the word x, in B”. This situation is illus- 
trated in Figure 11.2. 

Observe that we want an encoding function e to be one to one so that dif- 
ferent words in B” will be assigned different code words. 


Word b € B” 
to be sent 


Encoded word 
x= e(b) € B” 


Word x, € B? 
received 


Transmission channel 


Figure 11.2 


If the transmission channel is noiseless, then x, = x for all x in B”. In this 
case x = e(b) is received for each b € B”, and since ¢ is a known function, b may 
be identified. 

In general, errors in transmission do occur. We will say that the code word 
x = e(b) has been transmitted w:.th & or fewer errors if x and x, differ in at least 
1 but no more than k positions. 

Let e: B” > B" be an (m,n) encoding function. We say that e detects k or 
fewer errors if whenever x = e(>) is transmitted with & or fewer errors, then , is 
not a code word (thus x, could not be x and therefore could not have been cor- 
rectly transmitted). If x € B”, then the number of 1’s in x is called the weight of 
x and is denoted by |x]. 


Example 1. Find the weight of each of the following words in B*: (a) x = 01000; 
(b) x = 11100; (c) x = 00000; (d) x = 11111. 


Solution 

(a) |xJ}=1.  (b) x}=3. ()fx]=-0 @xl=5 
Example 2 (Parity Check Code). The following encoding function e: B" > B™*! 
is called the parity (#2, m + 1) check code: If b = b,b,---b,, € B”, define 

e(b) = b,b, a by Pats 

where 
_{0 — if|b{is even 
ml l1 if |b] is odd. 


Observe that b,,,,, is zero if and only if the number of 1’s in b is an even number. 
It then follows that every code word e(b) has even weight. A single error in the 
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transmission of a code word will change the received word to a word of odd 
weight and therefore can be detected. In the same way we see that any odd num- 
ber of errors can be detected. 

For a concrete illustration of this encoding function, let m = 3. Then 


e(000) = 0000 
e(001) = 0011 
e(010) = 0101 
e(011) = 0110 


code words. 
e(100) = 1001 
e(101) = 1010 
e(110) = 1100 


e(111) = 1111 


Suppose now that b = 111. Then x = e(b) = 1111. If the transmission channel 
transmits x as x, = 1101, then |x,| = 3, and we know that an odd number of errors 
(at least one) has occurred. Sd 


It should be noted that if the received word has even weight, then we can- 
not conclude that the code word was transmitted correctly, since this encoding 
function does not detect an even number of errors. Despite this limitation, the 
parity check code is widely used. 


Example 3. Consider the following (m, 37) encoding function e : B” — B”", If 
b = bb, ---b,, © B®, 
define 
e(b) = e(b,b, +++ b,,) = bb. +++ b,,b by +++, .byby ++ +b, 


That is, the encoding function e repeats each word of B” three times. For a con- 
crete example, let m = 3. Then 


e(000) = 000000000 
e(001) = 001001001 
e(010) = 010010010 
e(011) = 011011011 
e(100) = 100100100 
e(101) = 101101101 
e(110) = 110110110 
e(111) = 111111111 


code words. 


Suppose now that b = 011. Then e(011) = 011011011. Assume now that the trans- 
mission channel makes an error in the underlined digit and that we receive the 
word 011111011. This is not a code word, so we have detected the error. It is not 
hard to see that any single error and any two errors can be detected. o 
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Let x and y be words in 5”. The Hamming distance 5(x, y) between x and 
y is the weight, |x @ yj, of x ® y. Thus the distance between x = x,x,---x,, and 
Y =Y,¥2°**Y», is the number of values of i such that x, # y,, that is, the number 
of positions in which x and y differ. 


Example 4. Find the distance between x and y: 
(a) x = 110110, y = 000101. 
(b) x = 001100, y = 010110. 


Solution 
(a) x @y = N0011,s0 |x Dy| =4. 
(b) x @ y = 011010, so |x D y| = 3. % 


Theorem 1 (Properties of the Distance Function). Let x, y, and z be elements of 
B". Then 

(a) d(x, y) = &(y, x). 

(b) 5(x, y) = 0. 

(c) 8(x, y) = 0 if and only if x = y. 

(d) 8x, y) = 6, z) + 8(z, y). 


Proof: Properties (a), (b), and (c) are simple to prove and are left as exer- 
cises. 
(d) For a and b in B”, 


|a@ b| = al + |b 


> 


since at any position where a and b differ one of them must contain a 1. 
Also, if a € B”, then a @ a = 0, the identity element in B”. Then 


(x,y) =|x Py|=|x POSy| =|x Oz Oz @y| 
=|x€z|+\z@y| 
= &(x, 2) + 6(z, y). Sd 


The minimum distance of an encoding function e: B” > B" is the minimum 
of the distances between all distinct pairs of code words; that is, 


min [8(e(x), e(y)) |x, y € B”). 


Example 5. Consider the following (2,5) encoding function e: 


e(00) = 00000 
e(10) = 0011 code words. 
e(01) = 01110 
e(i1) = 11111 


The minimum distance is 2, as can be checked by computing the minimum of the 
distances between all six distinct pairs of code words. 6 


Theorem 2. An (m,n) encoding function e : B” > B” can detect k or fewer errors 
if and only if its minimum distance is at least k + 1. 
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Proof: Suppose that the minimum distance between any two code words 
is at least A + 1. Let b © B”, and let x = e(b) © B” be the code word rep- 
resenting b. Then x is transmitted and is received as x,. If x, were a code 
word different from x, then 5(x,x,) = k + 1,so x would be transmitted with 
k + 1 or more errors. Thus, if x is transmitted with & or fewer errors, then x, 
cannot be a code word. This means that e can detect k or fewer errors. 
Conversely, suppose that the minimum distance between code words is 
r =k, and let x and y be code words with 8(x, y) = r. If x, = y, that is, if x is 
transmitted and is mistakenly received as y, then r = & errors have been 
committed and have not been detected. Thus it is not true that e can detect 
k or fewer errors. Sd 


Example 6. Consider the (3, 8) encoding function e : B? — B® defined by 


e(000) = 00000000 
e(001) = 10111000 
e(010) = 00101101 
e(011) = 10010101 
e(100) = 10100100 
e(101) = 10001001 
e(110) = 00011100 
e(111) = 00110001 


code words. 


How many errors will e detect? 


Solution: The minimum distance of e is 3, as can be checked by comput- 
ing the minimum of the distances between all 28 distinct pairs of code 
words. By Theorem 2, the code will detect & or fewer errors if and only if its 
minimum distance is at least A + 1. Since the minimum distance is 3, we 
have 3 = k + 1 or k S2.Thus the code will detect two or fewer errors @ 


Group Codes 


So far, we have not made use of the fact that (B”, ®) is a group. We shall now 
consider an encoding function that makes use of this property of B”. 
An (m,n) encoding function e: B” > B” is called a group code if 


e(B”) = {e(b) |b € B”} = Ran(e) 


is a subgroup of B”. 

Recall from the definition of subgroup given in Section 9.4 that N is a 
subgroup of B” if (a) the identity of B” is in N, (b) if x and y belong to N, then 
x @® y EN, and (c) if x is in N, then its inverse is in N. Property (c) need not be 
checked, since every element in B” is its own inverse. Moreover, since B” is 
Abelian, every subgroup of B” is a normal subgroup. 
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Example 7. Consider the (3, 6) encoding function e : B* + B® defined by 


e(000) = 000000 
e(001) = 001100 
e(010) = 010011 
e(011) = 011111 
e(100) = 100101 
e(101) = 101001 
e(110) = 110110 
e(111) = 111010 


code words. 


Show that this encoding function is a group code. 
Solution: We must show that the set of all code words 
N = {000000, 001100, 010011, 011111, 100101, 101001, 110110, 111010} 


is a subgroup of B®. This is done by first noting that the identity of B® 
belongs to N. Next we verify, by trying all possibilities, that if x and y are ele- 
ments in N, then x @ y is in N. Hence N is a subgroup of B®, and the given 
encoding function is a group code. 5 


Theorem 3. Let e:B”" — B" be a group code. The minimum distance of e is the 
minimum weight of a nonzero code word. 


Proof: Let 6be the minimum distance of the group code, and suppose that 
& = 8(x, y), where x and y are distinct code words. Also, let n be the mini- 
mum weight of a nonzero code word and suppose that n = |z| for a code 
word z. Since ¢ is a group code, x @ y is a nonzero code word. Thus 


= (x,y) =|x@y/ =n. 
On the other hand, since 0 and z are distinct code words, 
n=|z =|z@0l = 6(z,0 26 
Hence n = 6. Sd 


Example 8. The minimum distaace of the group code in Example 7 is 2, since 
by Theorem 3 this distance is equal to the smallest number of 1’s in any of the 
seven nonzero code words. To check this directly would require 28 different cal- 
culations. 


We shall now take a brief look at a procedure for generating group codes. 


First, we need several additional rzsults on Boolean matrices. Consider the set B 
with the operation + defined in Table 11.1. Now let D = [d,,] and E = [e,,| be 
m X n Boolean matrices. We define the mod 2 sum D @ E as the m X n Boolean 
matrix F = [f;,], where 


Si = dj, + € iy, 1lsism 1s5jsn. (Here + is addition in B.) 
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Example 9. We have 


1011 11041 1+1 041 1+0 1+1 
Oo 1 1 O7J@Gy1 1 0 1p;=fyO+1 14+1 140 O0F+1 
1001 011i 1+0 O+1 O+1 141 
0 1 1 0 
={1 0 1 1f. 
1 1 1 0 
Observe that if F = D @ E, then f,, is zero when both d,; and e;; are zero or both 
are one. a 


Next, consider the set B = {0, 1} with the binary operation given in 
Table 11.2. 


Table 11.2 
0 1 
0; 0 0 
1] 0 1 


This operation has been seen earlier in a different setting and with a different 
symbol. In Chapter 7 it was shown that B is the unique Boolean algebra with two 
elements. In particular, B is a lattice with partial order = defined by 0 = 0, 
0 = 1,1 = 1. Then the reader may easily check that if a and b are any two 
elements of B, 


a-b=a/\b (the greatest lower bound of a and 6). 


Thus Table 11.2 is just a summary of the operation /, renamed -. 

Let D = [d,,] be an m X p Boolean matrix, and let E = [e,,] be a p X n 
Boolean matrix. We define the mod 2 Boolean product D * E as the m X n matrix 
F = [f,], where 


fig = 4 My tdi Qj tere t+ diye 


pi lsism, 15jsun. 


This type of multiplication is illustrated in Figure 11.3. Compare this with similar 


figures in Section 1.5. 


Example 10. We have 


1 0 
E 1 ‘|. a reece: ale A 
o1i1 O-141-141-0 0-04+1-141-1] J1 Oy 

ool . 


The proof of the following theorem is left as an exercise. 
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In “1 S12 Cin 

Dy, 1 ©9 oon 
“i 

Pon Cm “m2 Cnn 


Tf an odd number of 
—-—______________» | corresponding pairs consists of 
two 1’s, then C25 1, 
and if an even number 
consists of two 1’s, then 
cy = 0. 


Figure 11.3 


Theorem 4. Let D and E be m X p Boolean matrices, and let F be ap Xn 
Boolean matrix. Then 


(D @ EF) *«F = (D«F) O(E* F). 
That is, a distributive property holds for ® and *. ¢ 


We shall now consider the element x = x,x, +++ x, © B” as the 1 x m matrix 
[x, Xyortt X,]- 


Theorem 5. Let m and n be normegative integers with m <n,r =n — m,and let 
H be ann Xr Boolean matrix. Then the function f,: B" — B' defined by 


fy) = x * H, xe B" 
is ahomomorphism from the group B" to the group B’. 
Proof: If x and y are elements in B”, then 
ful® Oy)=@ Dy) +H 
= (x + H) @ (y* H) by Theorem 4 
= fi) ® fur): 


Hence f;, is a homomorphism from B” to B’. Sd 
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Corollary 1. Let m,n,r,H, and f,, be as in Theorem 5. Then 
N={x€ B"|x«H=0} 
is a normal subgroup of B”. 


Proof: It follows from the results in Section 9.5 that N is the kernel of the 
homomorphism f;,, so it is a normal subgroup of B”. o 


Let m <nandr=n— _m.Ann X r Boolean matrix 


Ay Ay hy, 
hy hy hy, 
figs Fins limp 
alae ie ae 0? 
0 1 0 
n—-m==rrows t : 7 
0 Q we 7 


whose last r rows form the r x r identity matrix, is called a parity check matrix. 
We use H to define an encoding function e,: B” > B". If b = b,b, + +> b,,, let 
x = €y(b) = bib, +++ by, X\X_°** X,, where 
Xy = bys hy + byt hy Ho + Dit Pint 
X_ = Dye Ay + Bye hyg to + Bt ling 


(1) 
Xp = Dye hy + By My, H+ Ont Aine 

Theorem 6. Let x = yiy)-** ¥_X, °° x, © B". Then x * H = 0 if and only if 
x = e,,(b) for some b € B”. 


Proof: Suppose that x * H = 0.Then 
Vit hy + yor hy too + mt yy + x, = 0 
Vit yy + Yyt hy TV Ry + y= 0 


yy thy, tpt Mg, Fo + Sg Rin +X, = 0. 
The first equation is of the form 
a+x,=0, wherea=y,+hy + yothy tot Yn Am: 

Adding a to both sides, we obtain 

at(a+x,)=at+0=a 

(at+a)+x,=a 

O+x,=a sinceeata=0 
xX, =a. 
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This can be done for each row; therefore, 


X= Vy thy ty thy te ty Mai 1lsi=r. 


Letting b, = y,, by = ¥2,.--,b, = Yq, we see that x,,x,,...,x, satisfy the 
equations in (1). Thus b = b,b,--+b, € B” and x = e,,(b). 

Conversely, if x = e,,(b), the equations in (1) can be rewritten by adding 
x; to both sides of the ith equation, i = 1,2,...,n, as 


By hy + byt hy too + by Amy + 2% = 0 

byt Bag + by yy t+ + By Nye + X= 0 

byehy, + byt hy, tot By eh + x, = 0, 
which is merely x * H = 0 ¢ 

Corollary 2. e,,(B”) = {e,(b) | b € B™) is a subgroup of B". 
Proof: The result follows from the observation that 
€1(B”) = ker( fy) 

and from Corollary 1. Thus e,, is a group code. Sd 


Example 11. Let m =2,n = 5. and 


1 1 «0 
0 1 1 
H=/;1 0 0 
0 1 0 
0 0 1 


Determine the group code e,,: B? > B?. 
Solution: We have B® = {00, 10,01, 11}. Then 
e(00) = 00x,x2x;, 
where x,,x,,and x, are determined by the equations in (1). Thus 
xX, =X, =x,=0 
and 
e(00) = 00000. 
Next 
e(10) = 10x,x,x3. 
Using the equations in (1) with b, = 1 and b, = 0, we obtain 
x4,=1-:1+0-0=1 
4, =1-°14+0-1=1 
43=1-°0+0-1=0. 
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Thus x, = 1,x, = 1, and x; = 0,so 


Similarly (verify), 


EXERCISE SET 11.1 


Find the weights of the given words. 


1. 


2. 


5. 


6. 


(a) 1011 
(d) 011101 


(b) 0110 
(e) 11111 


(c) 1110 
(£) 010101 


Consider the (3, 4) parity check code. For each 
of the received words, determine whether an 
error will be detected. 
(a) 0100 (b) 1100 
(d) 1001 


(c) 0010 


. Consider the (m, 3m) encoding function of 


Example 3, where m = 4. For each of the 
received words, determine whether an error 
will be detected. 
(a) 011010011111 
(c) 010010110010 


(b) 110110010110 
(d) 001001111001 


Find the distance between x and y. 
(a) x = 1100010, y = 1010001 

(b) x = 0100110, y = 0110010 

(c) x = 00111001, y = 10101001 
(d) x = 11010010, y = 00100111 


Prove Theorem 1{a), (b), and (c). 


Find the minimum distance of the (2, 4) encod- 
ing function e. 


e(00) = 0000 
e(10) = 0110 
e(O1) = 1011 


e(11) = 1100 


e(10) = 10110. 


e(01) = 01011 


e(11) = 11101. 
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7. Find the minimum distance of the (3, 8) encod- 


ing function e. 


8. Consider the (2,6) encoding function e. 


e(000) = 00000000 
e(001) = 01110010 
e(010) = 10011100 
e(011) = 01110001 
e(100) = 01100101 
e(101) = 10110000 
e(110) = 11110000 
e(111) = 00001111 


e(00) = 000000 
e(10) = 101010 
e(01) = 011110 
e(11) = 111000 


(a) Find the minimum distance. 
(b) How many errors will e detect? 


9. Consider the (3, 9) encoding function e. 


e(000) = 000000000 
e(001) = 011100101 
e(010) = 010101000 
e(011) = 110010001 
e(100) = 010011010 
e(101) = 111101011 
e(110) = 001011000 
e(111) = 110000111 


(a) Find the minimum distance. 
(b) How many errors will e detect? 
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10. Show that the (2,5) encoding function e: B’ > B® 16. Compute 
defined by 
1 0 
2(00) = 00000 i le [: 1 "| 
e(01) = 01110 eal 24 


e(10) = 10101 


e(11) = 11011 17. Compute 
is a group code. 1 0 1 1 1 0 
0 1 a1;*fjo 1 i. 
11. Show that the (3,7) encoding function e: B? > B’ 10 1 1041 
defined by 
e(000) = 0000000 18. Let 
e(001) = 0010110 041 41 
e(010) = 0101000 01 1 
e(011) = 0111110 H=]1 0 0 
e(100) = 1000101 0 1 40 
e(101) = 1010011 0 0 1 


e(110) = 1101101 be a parity check matrix. Determine the (2, 5) 
e(111) = 1111011 group code function e,: B? > B°. 


is a group code. 


19, Let 

12. Find the minimum distance of the group code 1 0 0 

defined in Exercise 10. 01 21 

111 

13. Find the minimum distance of the group code He= 10 0 
defined in Exercise 11. 

0 1 #0 

0 0 1 


14. Compute 


be a parity check matrix. Determine the (3, 6) 
E , | @ [: 7 | group code e,: B? > B®. 
0 1 


20. Prove Theorem 4. 


15. Compute 


corRrR, 
a) 
POOR 
oror 
orro 
Pre OoR 


11.2. Decoding and Error Correction 


Consider an (mm, nm) encoding function e : B™ — B". Once the encoded word 
x = e(b) € B", for b € B", is received as the word x,, we are faced with the prob- 
lem of identifying the word b that was the original message. 

An onto function d: B” —. B” is called an (, m) decoding function associ- 
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ated with e if d(x,) = 6’ € B” is such that when the transmission channel has no 
noise, then b’ = b, that is, 


doe=l1 BM, 
where 1pm is the identity function on B”. The decoding function d is required to 
be onto so that every received word can be decoded to give a word in B”. It 


decodes properly received words correctly, but the decoding of improperly 
received words may or may not be correct. 


Example 1. Consider the parity check code that is defined in Example 2 
of Section 11.1. We now define the decoding function d: B"*! > B™. If y = 
Yi¥2° Ym Imo & B*, then 

A(y¥) = Yo" Mn 
Observe that if b = b,b,°-+b,, © B”, then 


(d e)(b) = d(e(b)) = b, 


sodoe =1gm. 
For a concrete example, let m = 4. Then we obtain d(10010) = 1001 and 
d(11001) = 1100. o 


Let e be an (m, m) encoding function and let d be an (n, m) decoding func- 
tion associated with e. We say that the pair (e, d) corrects & or fewer errors if 
whenever x = e(b) is transmitted correctly or with & or fewer errors and x, is 
received, then d(x,) = b. Thus x, is decoded as the correct message b. 


Example 2. Consider the (m, 3m) encoding function defined in Example 3 of 
Section 11.1. We now define the decoding function d : B*" + B”™. Let 

Y= Y¥2 °° Vin V+. °° YamVam+1 °°” Yam: 
Then 


d(y) = 222°" *Zm> 
where 


ae 1 if (Yj, ¥;+m» ¥2+2m} has at least two 1’s 
7 (0 if {¥, ¥i4 Yit2m} has less than two 1’s. 


That is, the decoding function d examines the ith digit in each of the three blocks 
transmitted. The digit that occurs at least twice in these three blocks is chosen as 
the decoded ith digit. For a concrete example, let m = 3. Then 


e(100) = 100100100 
e(011) = 011011011 
e(001) = 001001001. 
Suppose now that b = 011.Then e(011) = 011011011. Assume now that the trans- 


mission channel makes an error in the underlined digit and that we receive the 
word x, = 011111011. Then, since the first digits in two out of the three blocks are 
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0, the first digit is decoded as 0. Similarly, the second digit is decoded as 1, since 
all three second digits in the tnree blocks are 1. Finally, the third digit is also 
decoded as 1, for the analogous reason. Hence d(x,) = 011; that is, the decoded 
word is 011, which is the word that was sent. Therefore, the single error has been 
corrected. A similar analysis shows that, if e is this (m, 3m) code for any value of 
m and d is as above, then (e, d) corrects any single error. o 


Given an (m,n) encoding ‘unction e: B” + B”, we often need to determine 
an (n,m) decoding function « : B” + B” associated with e. We now discuss a 
method, called the maximum likelihood technique, for determining a decoding 
function d for a given e. 

Since B” has 2” elements, there are 2” code words in B”. We first list the 
code words in a fixed order: 


DP 2), 


If the received word is x,, we compute 5(x™, x,) for 1 < i = 2” and choose the 
first code word, say it is x, such that 


_ min, ,(8(x,x)) = 62°, x,). 


That is, x“ is a code word that is closest to x, and the first in the list. If x®) = e(b), 
we define the maximum likelihood decoding function d associated with e by 


d(x, = b. 


Observe that d depends on the particular order in which the code words in e(B”) 
are listed. If the code words are listed in a different order, we may obtain a dif- 
ferent maximum likelihood deccding function d associated with e. 


Theorem 1. Suppose that e is an (m,n) encoding function and d is a maximum 
likelihood decoding function associated with e. Then (e, d) can correct k or fewer 
errors if and only if the minimum distance of e is at least 2k + 1. 


Proof: Assume that the minimum distance of ¢ is at least 2k + 1.Let b € B” 
and x = e(b) € B". Suppose that x is transmitted with & or fewer errors, and 
x, is received. This means that 6(x, x,) = k. If z is any other code word, then 


2k +1 8x, 2) S 8(x, x, + 6, z) Sk + d(x, Z). 


Thus 6(x, z) = 2k + 1—k =k + 1. This means that x is the unique code 
word that is closest to x, so d(x,) = b. Hence (e, d) corrects k or fewer 
errors. 

Conversely, assume that the minimum distance between code words is 
r = 2k, and let x = e(b) and x’ = e(b’) be code words with 6(x, x’) = r. 
Suppose that x’ precedes x in the list of code words used to define d. Write 
x = byb)--+b,, x’ = bib; +:-by. Then b, # b/ for exactly r integers i between 
1 and n. Assume, for simplicity, that b, # by, by # by,...,b, # bi, but 
b; = bj when i > r. Any other case is handled in the same way. 

(a) Suppose that r = k. {f x is transmitted as x, = x’, then r = k errors 
have been committed, but d(x,) = bso (e, d) has not corrected the r errors. 
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(b) Suppose that k + 1 <r < 2k, and let 
y = bibs + by by yy + by. 


If x is transmitted as x, = y, then (x, x’) =r — k= k and 6(,, x) = k. Thus 
x’ is at least as close to x, as x is, and x’ precedes x in the list of code words; 
so d(x,) # b. Then we have committed & errors, which (e, d) has not cor- 
rected. Sd 


Example 3. Let e be the (3, 8) encoding function defined in Example 6 of 
Section 11.1, and let d be an (8,3) maximum likelihood decoding function asso- 
ciated with e. How many errors can (e, d) correct? 


Solution: Since the minimum distance of e is 3, we have 3 = 2k + 1,s0 
& = 1. Thus (e, d) can correct one error. Sd 


We now discuss a simple and effective technique for determining a maxi- 
mum likelihood decoding function associated with a given group code. First, we 
prove the following result. 


Theorem 2. if K is a finite subgroup of a group G, then every left coset of K in 
G has exactly as many elements as K. 


Proof: Let aK be a left coset of K in G, where a € G. Consider the func- 
tion f: K — aK defined by 
f(k) = ak, fork € K. 


We show that fis one to one and onto. 
To show that fis one to one, we assume that 


F(A,) = fk), ky ky EK. 
Then 
ak, = ak,. 


By Theorem 2 of Section 9.4, k, = k,. Hence f is one to one. 
To show that f is onto, let b be an arbitrary element in aK. Then b = ak 
for some k € K. We now have 


f(k) = ak = b, 


so f is onto. Since f is one to one and onto, K and aK have the same num- 
ber of elements. Sd 


Let e : B” + B" be an (m, n) encoding function that is a group code. 
Thus the set N of code words in B” is a subgroup of B” whose order is 2”, say 
N= {x, 4,00, x2), 

Suppose that the code word x = e(b) is transmitted and that the word x, is 
received. The left coset of x, is 


x, N = {e, &,.--, em}, 


where ¢, = x, @ x. The distance from x, to code word x“ is just | ¢,|, the weight 
of ¢,. Thus, if e; is a coset member with smallest weight, then x) must be a code 
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word that is closest to x,. In this case, x = 0 @ x = x,@®x,@ x = x, @ 6. 
An element ¢,, having smallest weight, is called a coset leader. Note that a coset 
leader need not be unique. 

If e: B” > B" is a group code, we now state the following procedure for 
obtaining a maximum likelihood decoding function associated with e. 


Step 1. Determine all the left cosets of N = e(B”) in B”. 


STEP 2. For each coset, find a coset leader (a word of least weight). Steps 1 and 2 
can be carried out in a systematic tabular manner, which will be described later. 


Step 3. If the word x, is received, determine the coset of N to which x, belongs. 
Since N is a normal subgroup of B’, it follows from Theorems 3 and 4 of 
Section 9.5 that the cosets of N form a partition of B”,so each element of B” 
belongs to one and only one coset of N in B”. Moreover, there are 2/2” = 2° 
distinct cosets of N in B”. 


STep 4. Let € be a coset leader for the coset determined in step 3. Compute 
x= x,® elfx = e(d), we let d(x,) = b. That is, we decode x, as b. 


To implement the foregoing procedure, we must keep a complete list of all 
the cosets of N in B”, usually in tabular form, with each row of the table contain- 
ing one coset. We identify a coset leader in each row. Then, when a word x, is 
received, we locate the row that contains it, find the coset leader for that row, and 
add it to x, This gives us the cocle word closest to x, We can eliminate the need 
for these additions if we construct a more systematic table. 

Before illustrating with an example, we make several observations. Let 


No fe) x2, xO, 
where x“? is 0, the identity of B”. 
Steps 1 and 2 in the decoding algorithm above are carried out as follows. 


First, list all the elements of N in a row, starting with the identity 0 at the left. Thus 
we have 


GB xD xO oe. yO 
This row is the coset [0], and it has 0 as its coset leader. For this reason we will 
also refer to 0 as e,. Now choose any word y in B” that has not been listed in the 


first row. List the elements of the. coset y @ N as the second row. This coset also 
has 2” elements. Thus we have the two rows 


0 0) PC nrc) 
y@o y Ox y@x® ete y@ x, 
In the coset y @ N, pick an element of least weight, a coset leader, which we 
denote by e. In case of ties, choose any element of least weight. Recall from 
Section 9.5 that, since e?) € y @ N, we have y ® N = €® @ N. This means that 


every word in the second row can be written as € @ v, v € N. Now rewrite the 
second row as follows: 


AB A@x? Ox --- MO xe 


with e in the leftmost position. 
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Next, choose another element z in B” that has not yet been listed in either 
of the first two rows and form the third row (z @ x”), 1 <j <= 2” (another coset 
of N in B”). This row can be rewritten in the form 


AM AQx® O@OxO -- Ox”, 


where € is a coset leader for the row. 

Continue this process until all elements of B” have been listed. The result- 
ing Table 11.3 is called a decoding table. Notice that it contains 2’ rows, one for 
each coset of N. If we receive the word x,, we locate it in the table. If x is the ele- 
ment of N that is at the top of the column containing x,, then x is the code word 
closest to x,. Thus, if x = e(b), we let d(x,) = b. 


Table 11.3 


OQx® | MQxe @ x") 


LOx® | LO} O 2D. x2"-Y 


Example 4. Consider the (3, 6) group code defined in Example 7 of Section 
11.1. Here 


N = {000000, 001100, 010011, 011111, 100101, 101001, 110110, 111010} 


= {x x)... , x} 


defined in Example 1. We now implement the decoding procedure above for e as 
follows. 


STEPS 1 AND 2. Determine all the left cosets of N in B®, as rows of a table. For 
each row i, locate the coset leader ¢,, and rewrite the row in the order 


€é,®001100, ¢ @010011, ..., 6 @111010. 
The result is shown in Table 11.4. 


€, 


Table 11.4 


000000 001100 010011 011111 100101 101001 110110 111010 
000001 001101 010010 011110 100100 101000 110111 111011 
000010 001110 010001 011101 100111 101011 110100 111000 
000100 001000 010111 011011 100001 101101 110010 111110 
010000 011100 000011 001111 110101 111001 100110 101010 
100000 101100 110011 111111 000101 001001 010110 011010 
000110 001010 010101 011001 100011 101111 110000 111100 


010100 011000 000111 001011 110001 111101 100010 101110 


STEPS 3 AND 4. If we receive the word 000101, we decode it by first locating it in 
the decoding table: it appears in the fifth column, where it is underlined. The 
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word at the top of the fifth column is 100101. Since e(100) = 100101, we 
decode 000101 as 100. Similarly, if we receive the word 010101, we first locate 
it in the third column of the decoding table, where it is underlined twice. The 
word at the top of the third column is 010011. Since e(010) = 010011, we 
decode 010101 as 010. 


We make the following observations for this example. In determining the 
decoding table in steps 1 and 2, there was more than one candidate for coset leader 
of the last two cosets. In row 7 we chose 00110 as coset leader. If we had chosen 
001010 instead, row 7 would have appeared in the rearranged form 


001010 001010 <5 001100 --- 001010 @ 111010 
or 


001010 000110 011001 010101 101111 100011 111100 110000. 
The new decoding table is shown in Table 11.5. 


Table 11.5 


000000 001100 010011 Olt 100101 101001 110110 111010 
000001 001101 010010 01: 110 100100 101000 110111 111011 
000010 001110 010001 011101 100111 101011 110100 111000 
000100 001000 010111 011011 100001 101101 110010 111110 
010000 011100 000011 001111 110101 111001 100110 101010 
100000 101100 110011 114111 000101 001001 010110 011010 
001010 000110 011001 010101 101111 100011 111100 110000 


010100 011000 000111 001011 110001 111101 100010 101110 


Now, if we receive the word 010101, we first locate it in the fourth column 
of Table 11.5. The word at the top of the fourth column is 011111. Since 
e(011) = 011111, we decode 010101 as 011. oa 


Suppose that the (7, ) group code is e,, : B” — B", where H is a given par- 
ity check matrix. In this case, the decoding technique above can be simplified. We 
now turn to a discussion of this situation. 

Recall from Section 11.1 that r= n — m, 


Ay hy oe hy, 
In, fy cts hy, 
VF Ain Aner 
H= 1 0 ee 0 
Ge <0) Agee 4g 
and the function f;,, : B” — B’ defined by 
ty) = x*H 


is a homomorphism from the group B” to the group B’. 
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Theorem 3. /fm,n,r,H, and f,, are as above, then f,, is onto. 


Proof: Let b = b,b,---b, be any element in B”. Letting 


x = 00-+-05,b,---5, 
a 
m 0's 


we obtain x * H = b. Thus f,,(x) = b, so f;, is onto. 


It follows from Corollary 1 of Section 9.5 that B’ and B’/N are isomorphic, 
where N = ker(f,) = ey(B”), under the isomorphism g : B”/N — B’ defined by 


BQN) = fue) = x*H 


The element x * H is called the syndrome of x. We now have the following 
result. 


Theorem 4. Letx and y be elements in B”. Then x and y lie in the same left coset 
of N in B" if and only if f(x) = f(y), that is, if and only if they have the same 
syndrome. 


Proof: It follows from Theorem 4 of Section 9.5 that x and y lie in the 
same left coset of N in B” if and only if x ® y = (-x) @ y € N. Since 
N = ker(fy),x ® y € Nif and only if 


fale ® y) = Ope 
fu) © fyly) = Ogr 
fu) = fyQ)- 6d 


In this case, the decoding procedure given previously can be modified as 
follows. Suppose that we compute the syndrome of each coset leader. If the word 
x, is received, we also compute f,,(x,), the syndrome of x,. By comparing f,,(x,) 
and the syndromes of the coset leaders, we find the coset in which x, lies. Suppose 
that a coset leader of this coset is e. We now compute x = x,@ e If x = e(b), we 
then decode x, as b. Thus we need only the coset leaders and their syndromes in 
order to decode. We state the new procedure in detail. 


Step 1. Determine all left cosets of N = e,,(B”) in B”. 


STEP 2. For each coset, find a coset leader, and compute the syndrome of all 
leaders. 


Step 3. If.x,is received, compute the syndrome of x, and find the coset leader € hav- 
ing the same syndrome. Then x, @ € = x is a code word e,,(b), and d(x,) = b. 


For this procedure, we do not need to keep a table of cosets, and we can 
avoid the work of computing a decoding table. Simply list all cosets once, in any 
order, and select a coset leader from each coset. Then keep a table of these coset 
leaders and their syndromes. The procedure above is easily implemented with 
such a table. 
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Example 5. Consider the parity check matrix 


oor OF 
OoOrorR OF 
rFPoOoOorRrFRo® 


and the (3, 6) group e, : B’ > BS. Then 


e(000) == 000000 
e(001) = 001011 
e(010) = 010101 
e(011) = 011110 
e(100) == 100110 
e(101) =: 101101 
e(110) == 110011 
e(111) = 111000 


code words. 


Thus 
N = {000000, 001011, 0101.01, 011110, 100110, 101101, 110011, 111000}. 


We now implement the decoding procedure above as follows. 

In Table 11.6 we give only the coset leaders together with their syndromes. 
Suppose now that we receive the word 001110. We compute the syndrome of 
x, = 001110, obtaining f,,(x,) = ., * H = 101, which is the sixth entry in the first 
column of Table 11.6. This means that x, lies in the coset whose leader is 
e = 010000. We compute x = x, @® e€ = 001110 © 010000 = 011110. Since 
e(011) = 011110, we decode 001110 as 011. 


Table 11.6 
———<$>—_—_—_—- 
Syndrome 
of Coset 
Leader Coset Leader 

~ 000 000000 
. O01 000001 
010 000010 
o1l 001000 
100 000100 
101 010000 
110 100000 
111 001100 


ee ee ee Sa 


EXERCISE SET 11.2 


1, Let d be the (4, 3) decoding function defined by 
letting m be 3 in Example 1. Determine d(y) 
for the word y in B4. 

(a) y=0110 = (b) y= 1011 


2. Let d be the (6, 2) decoding function defined in 
Example 2. Determine d(y) for the word y in B®. 
(a) y=111011 —(b) y = 010100 


In Exercises 3 through 8, let e be the indicated 
encoding function and let d be an associated 
maximum likelihood decoding function. 
Determine the number of errors that (e, d) will 
correct. 


3. ¢ is the encoding function in Exercise 6 of 
Section 11.1. 


4. ¢ is the encoding function in Exercise 7 of 
Section 11.1. 


5. e¢ is the encoding function in Exercise 8 of 
Section 11.1. 


6. eis the encoding function in Exercise 9 of 
Section 11.1. 


7, eis the encoding function in Exercise 10 of 
Section 11.1. 


ba 


e is the encoding function of Exercise 11 of 
Section 11.1. 


eo 


. Consider the group code defined in Exercise 10 
of Section 11.1. Decode the following words 
relative to a maximum likelihood decoding 
function. 
(a) 11110 


(b) 10011 (ce) 10100 


10. Consider the (2, 4) group encoding function 
e : B? -y B* defined by 


e(00) = 0000 
e(01) = 0111 
e(10) = 1001 


e(11) = 1111 
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11. 


12 


13. 


Decoding and Error Correction 441 


Decode the following words relative to a maxi- 
mum likelihood decoding function. 
(a) 0011 (b) 1011 (c) 1111 


Consider the (3, 5) group encoding function 
e : B> > B? defined by 

e(000) = 00000 

e(001) = 00110 

e(010) = 01001 

e(011) = 01111 

e(100) = 10011 

e(101) = 10101 

e(110) = 11010 

e(111) = 11100 
Decode the following words relative to a maxi- 


mum likelihood decoding function. 
(a) 11001 (b) 01010 ~— (c) 00111 


Consider the (3, 6) group encoding function 
e : B? — B® defined by 

e(000) = 000000 

e(001) = 000110 

e(010) = 010010 

e(011) = 010100 

e(100) = 100101 

e(101) = 100011 

e(110) = 110111 

e(111) = 110001 


Decode the following words relative to a maxi- 
mum likelihood decoding function. 


(a) 011110 (b) 101011 (c) 110010 
Let 
1 1 
1 0 
H= 
1 0 
0 1 


be a parity check matrix. Decode the following 
words relative to a maximum likelihood decod- 
ing function. 
(a) 0101 


(b) 1010 (c) 1101 
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14, Let 
0 1 1 
1 0 1 
H=j1 O 0O 
0 1 0 
0 0 1 


be a parity check matrix. Decode the following 
words relative to a maximum likelihood decod- 
ing function associated with e,,. 


(a) 10100 —_(b) 01101 (c) 11011 


KEY IDEAS FOR REVIEW 


+ 


eee 6 


Ad 


Message: finite sequence of characters from a 
finite alphabet 

Word: sequence of 0’s and 1’s 

(m, n) encoding function: one-to-one function 
e:B™ +B" m<n 

Code word: element in Ran(e) 

Weight of x, |x|: number of 1’s in x 

Parity check code: see page 422 

Hamming distance between x and y, 6(x, y): 
Ix ®y| 

Theorem (Properties of the Distance Func- 
tion): Let x, y, and z be elements of B”. Then 
(a) d(x, y) = dy, x). 

(b) &(x, y) = 0. 

(c) (x, y) = Oif and only if x = y. 

(d) 8(x, y) = d(x, z) + Hz, y). 

Minimum distance of an (m,n) encoding func- 
tion: minimum of the distances between all dis- 
tinct pairs of code words 

Theorem: An (m, n) encoding function 
e:B™ ~ B" can detect k or fewer errors if and 
only if its minimum distance is at least k + 1. 
Group code: (m, n) encoding function 
e: B™ — B” such that e(B”) = {e(b) |b € B™} 
is a subgroup of B” 

Theorem: The minimum distance of a group 
code is the minimum weight of a nonzero code 
word, 


15. Let 
100 
110 
011 
A=)i 0 0 
0 1 0 
001 


be a parity check matrix. Decode the following 
words relative to a maximum likelihood decod- 
ing function associated with e,,. 

(a) 011001 (b) 101011 (c) 111010 


Mod 2 sum of Boolean matrices D and E, 
D © E: see page 426 

Mod 2 Boolean product of Boolean matrices D 
and E, D + E: see page 427 

Theorem: Let m and n be nonnegative integers 
with m <n,r =n — m,and let H be ann Xr 
Boolean matrix. Then the function f,,:B” + B’ 
defined by 


fide) = x * A, 


is a homomorphism from the group B” to the 
group B’. 

Group code e,, corresponding to parity check 
matrix H: see page 429 

(n, m) decoding function: see page 432 
Maximum likelihood decoding function associ- 
ated with e: see page 434 

Theorem: Suppose that e is an (7m, n) encoding 
function and d is a maximum likelihood decod- 
ing function associated with e. Then (e, d) can 
correct k or fewer errors if and only if the min- 
imum distance is at least 2k + 1. 

Decoding procedure for a group code: see page 
436 

Decoding procedure for a group code given by 
a parity check matrix: see page 439 


x € B 


CODING EXERCISES 


For each of the following, write the requested pro- 
gram or subroutine in pseudocode (as described in 
Appendix A) or in a programming language that 
you know. Test your code either with a paper-and- 
pencil trace or with a computer run. 


1. Write a function that finds the weight of a 
word in B”. 


2. Write a subroutine that computes the 
Hamming distance between two words in B”. 


3. Let M and N be Boolean matrices of size 
n Xn. Write a program that, given M and N, 
returns their mod 2 Boolean product. 
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Write a subroutine to simulate the (7, 377)- 
encoding function e: B” + B*” described in 
Example 3, Section 11.1. 


. Write a subroutine to simulate the decoding 


function d for the encoding function of Ex- 
ercise 4 as described in Example 2, Section 
11.2. 


APPENDIX A 


Algorithms 


ALGORITHMS AND 
PSEUDOCODE 


WY 


An algorithm is a complete list of the steps necessary to perform a task or com- 
putation. The steps in an algorithm may be general descriptions, leaving much 
detail to be filled in, or they may be totally precise descriptions of every detail. 


Example 1. A recipe for baking a cake can be viewed as an algorithm. It might 
be written as follows. 


1. ADD MILK TO CAKE: MIX. 

2. ADD EGG TO CAKE MIX AND MILK. 

3. BEAT MIXTURE FOR 2 MINUTES. 

4. POUR MIXTURE INTO PAN AND COOK IN OVEN FOR 40 MIN- 
UTES AT 350° F. 

END OF ALGORITHM 


It is a good idea to add the ast line so that there can be no mistake about 
where the algorithm ends. The algorithm above is fairly general and assumes that 
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the user understands how to pour milk, break an egg, set controls on an oven, and 
perform a host of other unspecified actions. If these steps were all included, the 
algorithm would be much more detailed, but long and unwieldy. One possible 
solution, if the added detail is necessary, is to group collections of related steps 
into other algorithms that we call subroutines and simply refer to these subrou- 
tines at appropriate points in the main algorithm. We hasten to point out that we 
are using the term subroutine in the general sense of an algorithm whose pri- 
mary purpose is to form part of a more general algorithm. We do not give the 
term the precise meaning that it would have in a computer programming lan- 
guage. Subroutines are given names, and when an algorithm wishes the steps in a 
subroutine to be performed, it signifies this by calling the subroutine. We will 
specify this by a statement CALL NAME, where NAME is the name of the sub- 
routine. 5 


Example 2. Consider the following version of Example 1, which uses subrou- 
tines to add detail. Let us title this algorithm BAKECAKE. 


ALGORITHM BAKECAKE 
1. CALL ADDMILK 

2. CALL ADDEGG 

3. CALL BEAT(2) 

4, CALL COOK(OVEN, 40, 350) 

END OF ALGORITHM BAKECAKE 


The subroutines of this example will give the details of each step. For example, 
subroutine ADDEGG might consist of the following general steps. 


SUBROUTINE ADDEGG 

1. Remove egg from carton. 

2. Break egg on edge of bowl. 

3. Drop egg, without shell, into bowl. 
4. RETURN 

END OF SUBROUTINE ADDEGG 


Of course, these steps could be broken into substeps, which themselves could be 
implemented as subroutines. The purpose of step 4, the “return” statement, is 
to signify that one should continue with the original algorithm that “called” the 
subroutine. Sa 


Our primary concern is with algorithms to implement mathematical com- 
putations, investigate mathematical questions, manipulate strings or sequences of 
symbols and numbers, move data from place to place in arrays, and so on. 
Sometimes the algorithms will be of a general nature, suitable for human use, and 
sometimes they will be stated in a formal, detailed way suitable for programming 
in a computer language. Later in this appendix we will describe a reasonable lan- 
guage for stating algorithms. 

It often happens that a test is performed at some point in an algorithm, and 
the result of this test determines which of two sets of steps will be performed 
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next. Such a test and the resulting decision to begin performing a certain set of 
instructions will be called a branch. 


Example 3. Consider the following algorithm for deciding whether to study for 
a “discrete structures” test. 


ALGORITHM FLIP 

1. Toss a coin. 

. IF the result is “heads,” GO TO 5. 

. Study for test. 

. GOTO 6. 

. See a show. 

. Take a test next day. 

END OF ALGORITHM FLIP Sa 


Rok wh 


Note that the branching is accomplished by GO TO statements, which 
direct the user to the next instruction to be performed, in case it is not the next 
instruction in sequence. In the past, especially for algorithms written in computer 
programming languages such as FORTRAN, the GO TO statement was univer- 
sally used to describe branches. Since then there have been many advances in the 
art of algorithm and computer program design. Out of this experience has come 
the view that the indiscriminate use of GO TO statements to branch from one 
instruction to any other instructi.cn leads to algorithms (and computer programs) 
that are difficult to understand, tard to modify, and prone to error. Also, recent 
techniques for actually proving tt.at an algorithm or program does what it is sup- 
posed to do will not work in the presence of unrestricted GO TO statements. 

In light of the foregoing remarks, it is a widely held view that algorithms 
should be structured. This term refers to a variety of restrictions on branching, 
which help to overcome difficulties posed by the GO TO statement. In a struc- 
tured branch, the test condition fcllows an IF statement. When the test is true, the 
instructions following a THEN statement are performed. Otherwise, the instruc- 
tions following an ELSE statement are performed. 


Example 4. Consider again the algorithm FLIP described in Example 3. The 
following is a structured version of FLIP. 


ALGORITHM FLIP 
1. Toss a coin. 
2. IF (heads results) THEN 
a. Study for test. 
3. ELSE 
a. See a show. 
4. Take test next day. 
END OF ALGORITHM FLIP 


This algorithm is easy to read and is formulated without GO TO state- 
ments. In fact, it does not require numbering or lettering of the steps, but we keep 
these to set off and emphasize the instructions. Of course, the algorithm FLIP of 
Example 3 is not very different from that of Example 4. The point is that the 
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GO TO statement has the potential for abuse, which is eliminated in the struc- 
tured form. ad 


Another commonly encountered situation that calls for a branch is the 
loop, in which a set of instructions is repeatedly followed either for a definite 
number of times or until some condition is encountered. In structured algorithms, 
a loop may be formulated as shown in the following example. 


Example 5. The following algorithm describes the process of mailing 50 invita- 
tions. 


ALGORITHM INVITATIONS 
1. COUNT < 50 
2. WHILE (COUNT > 0) 
a. Address envelope. 
b. Insert invitation in envelope. 
c. Place stamp on envelope. 
d, COUNT — COUNT - 1 
3. Place envelopes in mailbox. 
END OF ALGORITHM INVITATIONS 


In this algorithm, the variable COUNT is first assigned the value 50. The 
symbol < may be read “is assigned.” The loop is handled by the WHILE 
statement. The condition COUNT > 0 is checked, and as long as it is true, 
statements a through d are performed. When COUNT = 0 (after 50 steps), the 
looping stops. ¢ 


Later in this appendix we will give the details of this and other methods of 
looping, which are generally considered to be structured. In structured algo- 
rithms, the only deviations permitted from a normal, sequential execution of 
steps are those given by loops or iterations and those resulting from the use of 
the IF-THEN-ELSE construction. Use of the latter construction for branching is 
called selection. 

Tn this book we will need to describe numerous algorithms, many of which 
are highly technical. Description of these algorithms in ordinary English may be 
feasible, and in many cases we will give such descriptions. However, it is often 
easier to get an overview of an algorithm if it is presented in a concise, symbolic 
form. Some authors use diagrammatic representations called flow charts for this 
purpose. Figure A.1 shows a flow chart for the algorithm given in Example 4. 
These diagrams have a certain appeal and are still used in the computer pro- 
gramming field, but many believe that they are undesirable since they are more 
in accord with older programming practice than with structured programming 
ideas. 

The other alternative is to express algorithms in a way that resembles a 
computer programming language or to use an actual programming language such 
as PASCAL. We choose to use a pseudocode language rather than an actual pro- 
gramming language, and the earlier examples of this section provide a hint as to 
the structure of this pseudocode form. There are several reasons for making this 
choice. First, knowledge of a programming language is not necessary for the 
understanding of the contents of this book. The fine details of a programming 
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Study for test 


, 
( Take test 


C STOP 


Figure A.1 


language are necessary for communication with a computer, but may serve only 
to obscure the description of an algorithm. Moreover, we feel that the algorithms 
should be expressed in such a wey that an easy translation to any desired com- 
puter programming language is possible. Pseudocode is very simple to learn and 
easy to use, and it in no way interferes with one’s learning of an actual program- 
ming language. 

The second reason for using pseudocode is the fact that many professional 
programmers believe that developing and maintaining pseudocode versions of a 
program, before and after translation to an actual programming language, 
encourage good programming practice and aid in developing and modifying pro- 
grams. We feel that the student should see a pseudocode in use for this reason. 
The pseudocode described is largely taken from Rader (Advanced Software 
Design Techniques, Petrocelli, New York, 1968) and has seen service in a practi- 
cal programming environment. We have made certain cosmetic changes in the 
interest of pedagogy. 

One warning is in order. An algorithm written in pseudocode may, if it is 
finely detailed, be very reminiscent of a computer program. This is deliberate, 
even to the use of terms like SUBROUTINE and the statement RETURN at the 
end of a subroutine to signify that we should return to the steps of the main algo- 
rithm. Also, the actual programming of algorithms is facilitated by the similarity 
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of pseudocode to a programming language. However, always remember that a 
pseudocode algorithm is not a computer program. It is meant for humans, not 
machines, and we are only obliged to include sufficient detail to make the algo- 
rithm clear to human readers. 


In pseudocode, successive steps are usually labeled with consecutive numbers. If 
a step begins a selection or a loop, several succeeding steps may be considered 
subordinate to this step (for example, the body of a loop). Subordinate lines are 
indented several spaces and labeled with consecutive letters instead of numbers. 
If these steps had subordinates, they in turn would be indented and labeled with 
numbers. We use only consecutive numbers or letters as labels, and we alternate 
them in succeeding levels of subordination. A typical structuring of steps with 
subordinate steps is illustrated in the following. 


1. line 1 
a. line 2 
b. line 3 
1. line 4 
2. line 5 
c. line 6 
2. line 7 
3. line 8 
a. line 9 
1. line 10 
b. line 11 
4. line 12 


Steps that have the same degree of indentation will be said to be at the 
same level. Thus the next line at the level of line 1 is line 7, while the next line at 
the level of line 3 is line 6, and so on. 

Selection in pseudocode is expressed with the form IF-THEN~ELSE, as 
follows: 


1. IF (CONDITION) THEN 


2. ELSE 


false-block 


The true- and false-blocks (to be executed respectively when CONDITION 
is true and CONDITION is false) may contain any legitimate pseudocode includ- 
ing selections or iterations. Sometimes we will omit statement 2, the ELSE state- 
ment, and the false-block. In this case, the true-block is executed only when 
CONDITION is true and then, whether CONDITION is true or false, control 
passes to the next statement that is at the same level as statement 1. 
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Example 6. Consider the following statements in pseudocode. Assume that X is 
a rational number. 


1. IF (X > 13,000) THEN 

a. Ye_X + 0.02(X — 13,000) 
2. ELSE 

a. Yo X + 0.03X 


In statement 1, CONDITION is: X > 13,000. If X is greater than 13,000, then Y 
is computed by the formula 


X + 0.02(X — 13,000), 
while if X = 13,000, then Y is computed by the formula 
X + 0,03X. Sd 


We will use the ordinary symbols of mathematics to express algebraic rela- 
tionships and conditions in pseudocode. The symbols +, —, x, and / will be used 
for the basic arithmetic operations, and the symbols <, >, =, =, =, and # will be 
used for testing conditions. The number X raised to the power Y will be denoted 
by XY, the square of a number A will be denoted by A’, and so on. Moreover, 
products such as 3 X A will be denoted by 3A, and so on, when no confusion is 
possible. 

We will use a left arrow, <-, rather than the equal sign, for assignments of 
values to variables. Thus, as in Example 6, the expression Y — X + .03X means 
that Y is assigned the value specified by the right-hand side. The use of = for 
this purpose conflicts with the use of this symbol for testing conditions. Thus 
X = X + 1 could either be an assignment or a question about the number X. The 
use of < avoids this problem. 

A fundamental way to express iteration expressions in pseudocode is the 
WHILE form: 


1. WHILE (CONDITION) 


repeat-block 


Here CONDITION is tested and, if true, the block of pseudocode follow- 
ing it is executed. This process is repeated until CONDITION becomes false, 
after which control passes to the next statement that is at the same level as state- 
ment 1. 


Example 7. Consider the following algorithm in pseudocode; N is assumed to 
be a positive integer. 


1.X<0 
2. Y<0 
3. WHILE (X < N) 
aXeX+1 
b Ye YVY+X 
4.Y<eY/2 
END OF ALGORITHM 
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In this algorithm, CONDITION is X < N. As long as CONDITION is true, 
that is, as long as X < N, statements a and b will be executed repeatedly. As soon 
as CONDITION is false, that is, as soon as XY = N, statement 4 will be executed. 
This means that the WHILE loop is executed N times and the algorithm com- 
putes 

1+2+:-:-4+N 
4 2 
which is the value of variable Y at the completion of the algorithm. Sd 


A simple modification of the WHILE form called the UNTIL form is use- 
ful and we include it, although it could be replaced by completely equivalent 
statements using WHILE. This construction is 


1. UNTIL (CONDITION) 


repeat-block 


Here the loop continues to be executed until the condition is true; that is, it con- 
tinues only as long as the condition is false. Also, CONDITION is tested after the 
repeat-block rather than before, so the block must be repeated at least once. 


Example 8. The algorithm given in Example 7 could also be written with an 
UNTIL statement as follows: 


1x<0 

2, Ye 0 

3. UNTIL (X 2 N) 
aXe—X+1 
bY<eYtX 

4. Y<Y/2 

END OF ALGORITHM 


In this algorithm, the CONDITION X = N is tested at the completion of 
step 3. If it is false, the body of step 3 is repeated. This process continues until the 
test reveals that CONDITION is true (when X = N). At that time step 4 is imme- 
diately executed. oa 


The UNTIL form of iteration is a convenience and could be formulated 
with a WHILE statement. The form 


1. UNTIL (CONDITION) 


is actually equivalent to the form 


. [ie] 


2. WHILE (CONDITION = FALSE) 
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In each case, the instructions in block 1 are followed once, regardless of 
CONDITION. After this, CONDITION is checked, and, if it is true, the process 
stops; otherwise, block 1 instructions are followed again. This procedure of check- 
ing CONDITION and then repeating instructions in block 1 if CONDITION is 
false is continued until CONDITION is true. Since both forms produce the same 
results, they are equivalent. 

The other form of iteration is the one most like a traditional DO loop, and 
we express it as a FOR statemert: 


1. FOR VAR = X THRU Y [BY Z] 


repeat-block 


In this form, VAR is an integer variable used to count the number of times the 
instructions in repeat-block have been followed. X, Y, and Z, if desired, are either 
integers or expressions whose computed values are integers. The variable VAR 
begins at X and increases Z units at a time (Z is 1 if not specified). After each 
increase in X, the repeat-block is executed as long as the new value of X is not 
greater than Y. The conditions on VAR, specified by X, Y, and Z, are checked 
before each repetition of the instructions in the block. The block is repeated only 
if those conditions are true. The rackets around BY Z are not part of the state- 
ment, but simply mean that this part is optional and may be omitted. Note that 
the repeat block is always executed at least once, since no check is made until Y 
is changed. 


Example 9. The pseudocode statement 
FOR VAR = 2 THRU 10 BY 3 


will cause the repeat-block to be executed three times, corresponding to 
VAR = 2,5, 8. The process ends then, since the next value of VAR would be 11, 
which is greater than 10. ry 


We will use lines of pseuciccode by themselves to illustrate different parts 
of a computation. However, when the code represents a complete thought, we 
may choose to designate it as an algorithm, a subroutine, or a function. 

A set of instructions that will primarily be used at various places by other 
algorithms is often designated as a subroutine. A subroutine is given a name for 
reference, a list of input variables, which it will receive from other algorithms, and 
output variables, which it will pass on to the algorithms that use it. A typical title 
of a subroutine is 


SUBROUTINE NAME (4, 8B,...;X, Y,...) 


The values of the input variables are assumed to be supplied to the sub- 
routine when it is used. Here NAME is a name generally chosen as a memory aid 
for the task performed by the subroutine; A, B, and so on, are input variables; and 
X, Y, and so on, are output variables. The semicolon is used to separate input vari- 
ables from output variables. 

A subroutine will end with the statement RETURN. As we remarked ear- 
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lier in this section, this simply reminds us to return to the algorithm (if any) that 
is using the subroutine. 
An algorithm uses a subroutine by including the statement 


CALL NAME (A, B,...:.X,Y,...) 


where NAME is a subroutine and the input variables A, B, and so on, have all 
been assigned values. This process was also illustrated in earlier examples. 


Example 10. The following subroutine computes the square of a positive inte- 
ger N by successive additions. 


SUBROUTINE SOR(N; X) 
1X<eN 
2, ¥Y¢1 
3. WHILE(Y # N) 
a Xe XIN 
b Ye Y+1 
4. RETURN 
END OF SUBROUTINE SQR ¢ 


If the result of the steps performed by a subroutine is a single number, we 
may call the subroutine a FUNCTION. In this case, we title such a program as 
follows: 


FUNCTION NAME(A, B, C,...) 


where NAME is the name of the function and A, B, C,... are input variables. We 
also specify the value to be returned as follows: 


RETURN(Y) 


where Y is the value to be returned. 

The name FUNCTION is used because such subroutines remind us of 
familiar functions such as sin(x), log(x), and so on. When an algorithm requires 
the use of a function defined elsewhere, it simply uses the function in the famil- 
iar way and does not use the phrase CALL. Thus, if a function FN1 has been 
defined, the following steps of pseudocode will compute 1 plus the value of the 
function FN1 at 3X + 1. 


1.Ye3x+1 
2. Ye 1+ FNI(Y) 


Example 11. The program given in Example 10 can be written as a function as 
follows: 


FUNCTION SQR(NV) 
1X<eN 
2.Ye1 
3. WHILE (Y # N) 
a Xe X+N 
b Y<eYt1 
4, RETURN (X) 
END OF FUNCTION SOR ¢ 
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Variables such as Y in Examples 10 and 11 are called local variables, since 
they are used only by the algorithm in its computations and are not part of input 
or output. 

We will have many occasicns to use linear arrays, as we need to be able to 
incorporate them into algorithms written in pseudocode. An array A will have 
locations indicated by A[1], A[2]. A[3], ... (as we noted in Section 1.3) and we will 
use this notation in pseudocode statements. Later, we will introduce arrays with 
more dimensions. In most actual programming languages, such arrays must be 
introduced by dimension statements or declarations, which indicate the maxi- 
mum number of locations that inay be used in the array and the nature of the 
data to be stored. In pseudocode we will not require such statements, and the 
presence of brackets after a variable will indicate that the variable names an 
array. 


Example 12. Suppose that X[1],X[2],...,4[N] contain real numbers and that 
we want to exhibit the maximum such number. The following instructions will do 
that. 


1. MAX © X[1] 
2. FOR / = 2 THRU N 
a. IF (MAX < X[I]) THEN 
1. MAX © X[/] 
3. RETURN (MAX) o 


Example 13. Suppose that A[1], A[2],..., A[N] contain 0’s and 1’s so that A 
represents a subset (which we will also call A) of a universal set U with N ele- 
ments (see Section 1.3). Similarly, a subset B of Uis represented by another array, 
B[1], B[2],..., BIN]. The following pseudocode will compute the representation 
of the union C = A U B and store it in locations C[1], C[2],..., C[N] of an 
array C. 


1. FORI = 1THRUN 
a. IF ((A[/] = 1) OR (E[/] = 1)) THEN 
1.CUel 
b. ELSE 
1. CZ] <0 + 


We will find it convenient to include a PRINT statement in the pseudocode. 
The construction is 

1. PRINT (‘message’) 
This statement will cause ‘message’ to be printed. Here we do not specify 


whether the printing is done on the computer screen or on paper. 


Finally, we do include a GO TO statement to direct attention to some other 
point in the algorithm. The usage would be GO TO LABEL, where LABEL is a 
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name assigned to some line of the algorithm. If that line had the number 1, for 
example, then the line would have to begin 


LABEL: 1... 


We avoid the GO TO statement when possible, but there are times when 
the GO TO statement is extremely useful, for example, to exit a loop prematurely 


if certain conditions are detected. 


EXERCISE SET 


In Exercises 1 through 8, write the steps in 
pseudocode needed to perform the task 
described. 


1. In a certain country, the tax structure is as fol- 
lows. An income of $30,000 or more results in 
$6000 tax, an income of $20,000 to $30,000 pays 
$2500 tax, and an income of less than $20,000 
pays a 10% tax. Write a function TAX that 
accepts a variable INCOME and outputs the 
tax appropriate to that income. 


2. The following table shows brokerage commis- 
sions for firm X based on both price per share 
and number of shares purchased. 


Commission Schedule (per share) 


Less Than $150/Share 
$150/Share or More 


Less than 100 shares $3.25 $2.75 
100 shares or more $2.75 $2.50 


Write a subroutine COMM with input variables 
NUMBER and PRICE (giving number of 
shares purchased and price per share) and out- 
put variable FEE giving the total commission 
for the transaction (not the per share commis- 
sion). 


3. Let X,,X,,..., Xx be a given set of numbers. 
Write the steps needed to compute the sum and 
the average of the numbers. 


4, Write an algorithm to compute the sum of 
cubes of all numbers from 1 to N (that is, 
P+ 274+ 3% 4+ -+++ NP), 


5. 


6. 


? 


n 


Suppose that the array X consists of the real 
numbers X[1], X[2], X[3] and the array Y con- 
sists of the real numbers ¥Y [1], ¥ [2], Y [3]. 
Write an algorithm to compute 


XY] + XPV] + XBIYBI. 


Let the array A[1], A[2],..., A[N] contain the 
coefficients a), 4,..., da, of a polynomial 
a,x’. Write a subroutine that has the array 
A and variables N and X as inputs and has the 
value of the polynomial at X as output. 


Let A[1], A[2], A[3] be the coefficients of a 
quadratic equation ax? + bx + c = 0 (that is, 
A[1] contains a, A[2] contains b, and A[3] con- 
tains c). Write an algorithm that computes the 
roots R1 and R2 of the equation if they are real 
and distinct. If the roots are real and equal, the 
value should be assigned to R1 and a message 
printed. If the roots are not real, an appropriate 
message should be printed and computation 
halted. You may use the function SQRT (which 
returns the square root of any nonnegative 
number X). 


» Let [4,, a2), a2, a3),..., [4y—1,4y] be N adja- 


cent intervals on the real line. If A[1],..., A[N] 
contain the numbers 4,..., 4,, respectively, 
and X is a real number, write an algorithm that 
computes a variable INTERVAL as follows: 

If X is not between a, and ay, INTERVAL = 0; 
however, if X is in the ith interval, then 
INTERVAL = i. Thus INTERVAL specifies 
which interval (if any) contains the number X. 
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In Exercises 9 through 12, let A and B be 
arrays of length N that contain 0’s and 1’s, and 
suppose they represent subsets (which we also 
call A and B) of some universal set U with N 
elements. Write algorithms that specify an array 
C representing the set indicated. 


9 C=A@QB 
10. C=ANB 
1. C=ANB 
122. C=AN(A@B) 
In Exercises 13 through 20, write pseudocode 


Programs to compute the quantity specified. 
Here N is a positive integer. 


13. The sum of the first N nonnegative even 
integers. 


14. The sum of the first V nonnegative odd 
integers. 


15. The product of the first N positive even 
integers. 


16. The product of the first N positive odd integers. 


17. The sum of the squares of the first 77 positive 
integers. 


18. The sum of the cubes of the first 23 positive 
integers. 


19. The sum of the first 10 terms of the series 
Ss 1 
AA antl 

20. The smallest number of terms of the series 


< 1 
> 
n=l 


n+l 


whose sum exceeds 5. 


In Exercises 21 through 25, describe what is 
accomplished by the pseudocode. Unspecified 
inputs or variables X and Y represent rational 
numbers, while N and M represent integers. 


21, SUBROUTINE MAX(X, Y; Z) 
1Z¢Xx 
2. IF (X < Y) THEN 
a ZeY 
3. RETURN 
END OF SUBROUTINE MAX 


22. 1. X<— 0 
2. Lfe1 
3. WHILE (X < 10) 
a. Xe—X+ (1/1) 
b fel+l 


23. FUNCTION F(X) 
1. IF (X < 0) THEN 
a. Re -X 
2. ELSE 
a ReX 
3. RETURN (R) 
END OF FUNCTION F 


24. FUNCTION F(X) 
1. IF (X < 1) THEN 
a. Re X?4+1 
2. ELSE 
a. IF (X <3) THEN 
1.Re2X +6 
b. ELSE 
1,.Re-X+7 
3. RETURN (R) 
END OF FUNCTION F 


25. 1. IF (M < N) THEN 
a. ReO 
2. ELSE 

a KewN 

b. WHILE (K < M) 
1KeK+N 

c. IF (K = M) THEN 
1.Re1 

d. ELSE 
1.R<¢-O 


In Exercises 26 through 30, give the value of all 
variables at the time when the given set of 
instructions terminates. N always represents a 
positive integer. 


26. 1.21 
2,X<—0 
3. WHILE (J = N) 
a X@e—X+1 


b JeJ+1 


lel 

_xXx-0 

. WHILE (J = N) 
a XeX+T 
b Jes+1 


WNr 


-Ael 

Bel 

. UNTIL (B > 100) 
a. Be2A-—2 
b AGeAt+3 


wWNr 
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FOR |= 1 THRU 50 BY 2 
a X¥<0 
b X¥eX+1 


. IF (X < 50) THEN 


a. X—25 


. ELSE 


a X<0 


xe 
. Ye 100 
. WHILE (X < Y) 


a XeX+2 
b. YeRY 
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Experiment 1 
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In this experiment you will investigate a family of mathematical structures and 
classify family members according to certain properties that they have or do not 
have. In Section 1.4, we define x = r (mod n) ifx = kn +rwithO=r<n-— 1. 
This idea is used to define operations in the family of structures to be studied. 
There will be one member of the family for each positive integer n. Each mem- 
ber of the family has two operations defined as follows: 


a@®,b=a+b(modn), a ®), 5 = ab (mod n). 


For example, 5 © 8 = 13 (mod 3) = 1, because 13 = 4-3 + 1 and 4@,8 = 
32 (mod 5) = 2. The result of each operation mod n must be a number between 
0 and v — 1 (inclusive), so to satisfy the closure property for each operation we 
restrict the objects in the structure based on mod 7 to 0,1,2,..., — 1. Let 
Z,, = [{1,2,3,...,2 — 1}, @,, ©,,]. The Z, are the family of structures to be studied. 


Part I. Some examples need to be collected to begin the investigation. 


1. Compute each of the following. 


a. 7@,5 b. 4@,2 
c. 2@,3 d.1@.3 
e. 6@, 6 £ 7@s5 
g 4&2 h. 2@,3 
i 1@53 j. 6@,6 


2. Construct an operation table for @,, and an operation table for &,, for 
n = 2,3,4,5,6. There will be a total of 10 tables. These will be used in 
Part I. 


Part II. Properties that a mathematical structure can have are presented in 
Section 1.6. In this part you will see if some of these properties are satisfied by Z,, 
for selected values of n. 


1. Is ©, commutative for n = 2,3, 4,5, 6? Explain how you made your 


decisions. 

2. Is @,, associative for n = 2,3,4,5,6? Explain how you made your deci- 
sions. 

3. Is there an identity for @,, in Z, for n = 2,3, 4,5, 6? If so, give the iden- 
tity. 


4. Does each element of Z, have an @,-inverse for n = 4, 5, 6? If so, let 
—z denote the ®,-inverse of z and define a © b = a@,, (—b) and con- 
struct an ©, table. 

5. Solve each of the following equations. 

a 3Q@,x=2 b3@sx=2 c 3@.x =2 

6. Is ®&,, commutative for n = 2, 3, 4,5, 6? Explain how you made your 

decisions. 
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10. 


Is @&,, associative for » = 2,3,4,5,6? Explain how you made your deci- 
sions. 

Is there an identity for @, in Z, forn = 2,3, 4,5, 6? If so, give the iden- 
tity. 

Does each element of Z, have an ®),-inverse for n = 4, 5, 6? If so, let 
1/z denote the ®),-inverse of z and define a @b = a ©), (1/b) and con- 
struct an @, table. 

Solve each of the following equations. 

a.2@,x =0 for n = 3,4, 5,6 

b. x ®,3=2 for n = 4,5, 6,7 

ce 2®,x=1 for n = 3,4,5,6 


Here you will develop some general conclusions about the family of 


. Leta € Z, and a ¥ 0. Tell how to compute —a using 1 and a. 
. For which positive integers k does a ®, x = 1 have a unique solution 


for each a,0<a<k -- 1? 


. For which positive integers k does a ®, x = 1 not have a unique solu- 


tion for each a,0 <.a<k — 1? 


. Test your conjectures from questions 2 and 3 for & = 9, 10, and 11. If 


necessary, revise your answers for questions 2 and 3. 


. Ifa ®, x = 1 does not have a unique solution for each a,O<a<k — 


1, describe the relationship between a and & that guarantees that 
a. There are no solutions to a ®, x = 1. 
b. There is more than one solution toa ®, x = 1. 


. Describe k such that the following statement is true for Z,. 


a®,b=0 onlyif a=0orb=0 


Experiment 2 
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Many games and puzzles use strategies based on the rules of mathematical logic 
developed in Chapter 2. We begin here with a simple puzzle situation: construct 
an object from beads and wires that satisfies some given conditions. After inves- 
tigating this object, you will prove that it satisfies certain properties. 


Part I. 


Part II. 


Part III. 


Here are the conditions for the first object. 


a. You must use exactly three beads. 

b. There is exactly one wire between every pair of beads. 
c. Not all beads can be on the same wire. 

d. Any pair of wires have at least one bead in common. 


. Draw a picture of the object. 
. Your object might not be the only one possible, so the following state- 


ments are to be proved referring only to the conditions and not to your 
object. 


Tl. Any two wires have at most one bead in common. 
T2. There are exactly three wires. 
T3. No bead is on all the wires. 


Here are the conditions for the second object. 

a. You must use at least one bead, 

b. Every wire has exactly two beads on it. 

c. Every bead is on exactly two wires. 

d. Given a wire, there are exactly three other distinct wires that have 
no beads in common with the given wire. 


. Draw a picture of the object. 
. Your object might not be the only one possible, so the following state- 


ments are to be proved referring only to the conditions and not to your 
object. 


Tl. There is at least one wire. 

T2, Given a wire there are exactly two other wires that have a bead in 
common with the given wire. 

T3. There are exactly wires. 

T4. There are exactly beads. 


The two objects you created in Parts I and II can be viewed in a num- 


ber of ways. Instead of beads and wires, consider players and two-person teams, 
or substitute the words point and line for bead and wire. 


1. Translate the statements T1,T2, and T3 in Part I into statements about 


players and two-person teams. 


2. Translate the conditions given in Part II into statements about points 


and lines. 
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3. The type of object created here is often called a finite geometry, 
because each has a finite number of points and lines. What common 
geometric concept is described in condition d of Part II? 


4. The Acian Bolex Tournament will be played soon. Determine the num- 
ber of players needed and the number of teams that will be formed 
according to these ancient rules for bolex. 

. A team must consis: of exactly three players. 

. Two players may be on at most one team in common. 

. Each player must be on at least three teams. 

. Not all the players can be on the same team. 

At least one team must be formed. 
If a player is not on a given team, then the player must be on exactly 
one team that has no members in common with the given team. 


moangp 
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An old folktale says that in a faraway monastery there is a platform with three 
large posts on it and when the world began there were 64 golden disks stacked 
on one of the posts. The disks are all of different sizes arranged in order from 
largest at the bottom to smallest at the top. The disks are being moved from the 
original post to another according to the following rules: 


1. One disk at a time is moved from one post to another. 
2. A larger disk may never rest on top of a smaller disk. 
3. A disk is either on a post or in motion from one post to another. 


When the monks have finished moving the disks from the original post to one of 
the others, the world will end. How long will the world exist? 


A useful strategy is to try out smaller cases and look for patterns. Let N, be 
the minimum number of moves that are needed to move & disks from one post 
to another. Then N, is 1 and N, is 3. (Verify this.) 


1. By experimenting, find N3, N,, Ns. 

2. Describe a recursive process for transferring & disks from post 1 to post 
3. Write an algorithm to carry out your process. 

3. Use the recursive process in part 2 to develop a recurrence relation for 
N,. 

4. Solve the recurrence relation in part 3 and verify the solution by compar- 
ing the results produced by the solution and the values found in part 1. 

5. From part 4 you have an explicit formula for N,. Use mathematical 
induction to prove that this statement is true. 

6. If the monks move one disk per second and never make a mistake, how 
long (to the nearest year) will the world exist? 
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Experiment 4 


Equivalence relations and partial orders are defined as relations with certain 
properties. In this experiment, you will investigate compatibility relations that are 
also defined by the relation properties they have. A compatibility relation is a 
relation that is reflexive and symmetric. Every equivalence relation is a compat- 
ibility relation, but here you will focus on compatibility relations that are not 
equivalence relations. 


Part I 


1. Verify that the relation R on A is a compatibility relation. 

a. A is the set of students at your college; x R y if and only if x and y 
have taken the sane course. 

b. A is the set of all triangles; x R y if and only if x and y have an angle 
with the same measure. 

c. A = {1,2,3, 4,5}: R = {(1, 1), (2, 2), (3.3), (4, 4), (5, 5), (2, 3), (3, 2), 
(4,1), (1, 4), (2, 4), (4, 2), (2,1), (1, 2), (4, 5), (5, 4), (1, 3), 3, 1}. 

2. In Part I.1c, the relation is given as a set of ordered pairs. A relation can 
also be represented by a matrix or a digraph. Describe how to deter- 
mine if R is a compat:bility relation using its 
a. Matrix. 

b, Digraph. 

3. Give another example of a compatibility relation that is not an equiva- 

lence relation. 


Part II. Every relation has several associated relations that may or may not 
share its properties. 


1. If R is a compatibility relation, is R~’, the inverse of R, also a compati- 
bility relation? If so, prove this. If not, give a counterexample. 

2. If R is a compatibility relation, is R, the complement of R, also a com- 
patibility relation? If so, prove this. If not, give a counterexample. 

3. If R and S are compatibility relations, is R  S also a compatibility rela- 
tion? If so, prove this. I not, give a counterexample. 


Part III. In Section 4.5, we showed that each equivalence relation R on aset A 
gives a partition of A. A compatibility relation R on a set A gives instead a cov- 
ering of A. A covering of A is a set of subsets of A, {A,, A, ...,A,}, such that 


k 

\_) A; = A. We define a maximal compatibility block to be a subset B of A with 
i=l 

each element of B related by R to every other element of B, and no element of 
A — B is R-related to every element of B. For example, in Part I.1c, the sets 
{1, 2, 3} and {1,2, 4} are maximal compatibility blocks. The set of all maximal com- 
patibility blocks relative to a compatibility relation R form a covering of A. 
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1. Give all maximal compatibility blocks for the relation in Part I.1c. 
Verify that they form a covering of A. 

2. Describe the maximal compatibility blocks for the relation in Part I.1b. 
The set of all maximal compatibility blocks form a covering of A. Is this 
covering also a partition for this example? Explain. 

3, The digraph of a compatibility relation R can be simplified by omitting 
the loop at each vertex and using a single edge with no arrow between 
related vertices. 

a. Draw the simplified graph for the relation in Part I-1c. 
b. Describe how to find the maximal compatibility blocks of a compat- 
ibility relation, given its simplified graph. 

4. Find the covering of A associated with the relation whose graph is 
given in 
a. Figure 1. 

b. Figure 2. 
c. Figure 3. 


Yy\Y 


3 
1 5 
5 6 6 
Figure 1 Figure 2 Figure 3 


5. Given the following covering of A, produce an associated compatibility 
relation R; that is, one whose maximal compatibility blocks are the ele- 
ments of the covering. 


{(1, 2}, (1,3, 6, 7}, (4,5, 11}, {5, 10}, (8, 5}, (2,8, 9}, (3, 9}, (9, 10}. 


Is there another compatibility relation that would produce the same 
covering of A? 
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Experiment 5 


The @-class of a function that describes the number of steps performed by an 
algorithm is referred to as the running time of the algorithm. In this experiment 
you will analyze several algorithms, presented in pseudocode, to determine their 
running times. 


Part I. The first algorithm is one method for computing the product of twon xn 
matrices. Assume that the matrices are each stored in an array of dimension 2 and 
that Ali, j] holds the element of A in row i and column j. 


ALGORITHM MATMUL(A, B; C) 
1. FOR/=1THRUN 
a. FORJ = 1 THRU N 
1. CA] <0 
2. FOR K = 1 THRUN 
a. Cll, J]<— C1, J] + Al, K] x B[K,J] 
END OF MATMUL 


Assume that each assignment of a value, each addition, and each element multi- 
plication take the same fixed arnount of time. 


1. How many assignments will be done in the second FOR loop? 
2. How many element multiplications are done in the third FOR loop? 
3, What is the running time of MATMUL? Justify your answer. 


Part II. The following recursive algorithm will compute n! for any positive inte- 


gern. 
ALGORITHM FAC(N) 
1. IF(N = 1) THEN 
a Aecl 
2. ELSE 


a, AC NxFAC(N - 1) 
3. RETURN (A) 
END OF FAC 


1. Let S,, be the number of steps needed to calculate n! using FAC. Write 
a recurrence relation for §, in terms of S,,_ ;. 

2. Solve the recurrence relation in part 1 and use the result to determine 
the running time of FAC. 


Part III. The function SEEK will give the cell in which a specified value is 
stored in cells i through i + m — 1 (inclusive) of an array A. Assume that i = 1. 


FUNCTION SEEK(ITEM, I, 1 + N — 1) 
1. CELL<0 
2. FORJ=/THRU/+N-1 

a. IF (A[J] = ITEM) THEN 

b. CELL/ J 


3. 
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RETURN (CELL) 


END OF FUNCTION SEEK 


1. 
2. 
3. 


Part IV. 
stored in 


How many cells are there from A[é] to A[i + n — 1] (inclusive)? 
Give a verbal description of how SEEK operates. 
What is the running time of SEEK? Justify your answer. 


The algorithm HUNT will give the cell in which a specified value is 
cells i through i + n — 1 (inclusive) of an array A. Assume that i = 1. 


To simplify the analysis of this algorithm, assume that n, the number of cells to be 
inspected, is a power of 2. 


ALGORITHM HUNT(/TEM, I,1 + N — 1) 


1. 
2. 


3. 


4, 
5. 
6. 
EN 
i 


2. 
3. 


CELL <0 
IF (N = 1 AND A[/] = ITEM) THEN 

a. CELL© 

ELSE 

a. CELL1 — HUNT(ITEM, I, 1 + N/2 — 1) 

b. CELL2 — HUNT(ITEM, I + N/2,1 + N — 1) 
IF (CELL1 # 0) THEN 

a. CELL «+ CELL 

ELSE 

a. CELL — CELL2 

RETURN (CELL) 
D OF HUNT 


Give a verbal description of how HUNT operates. 
What is the running time of HUNT? Justify your answer. 


Under what circumstances would it be better to use SEEK (Part III) 
rather than HUNT? When would it be better to use HUNT rather than 
SEEK? 
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Experiment 6 


The purpose of this experimerit is to introduce the concept of a Markov chain. 
The investigations will use your knowledge of probability and matrices. 
Suppose that the weather in Acia is either rainy or dry. We say that the 
weather has two possible states. As a result of extensive record keeping, it has 
been determined that the probability of a rainy day following a dry day is 5, 
and the probability of a rainy day following a rainy day is 5. If we know the 
weather today, then we can predict the probability that it is rainy tomorrow. In 
fact, if we know the state in which the weather is today, then we can predict the 
probability for each possible state tomorrow. A Markov chain is a process in 
which the probability of a system’s being in a particular state at a given observa- 
tion period depends only on its state at the immediately preceding observation 
period. Let 7; be the probability that if the system is in state j at a certain obser- 
vation period it will be in state i at the next period; ¢;; is called a transition prob- 
ability. It is convenient to arrange the transition probabilities for a system with n 
possible states as an n X rn transition matrix. A transition matrix for Acia’s weather is 


DR 

r-[f i]? 
—~]T1 1 
3 2]R 


1. What is the sum of the entries in each column of T? Explain why this 
must be the same for zach column of any transition matrix. 


The transition matrix of a Markov chain can be used to determine the prob- 
ability of the system being in any of its m possible states at future times. Let 


denote the state vector of the Markov chain at the observation period k, where 
pi is the probability that the system is in state j at the observation period k.The 
state vector P() is called the initial state vector. 


2. Suppose today, a Wednesday, is dry in Acia and this is observation 
period 0. 
a. Give the initial state vector for the system. 
b. What is the probability that it will be dry tomorrow? What is the 
probability that it will be rainy tomorrow? Give P®. 
c. Compute TP, What is the relationship between TP and P“? 


It can be shown that, in general, P® = T*P©. Thus the transition matrix 
and the initial state vector completely determine every other state vector. 


3. Using the initial state vector from part 2, what is the state vector for 
a. Friday? 
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b. Sunday? 
c. Monday? 
d. What appears to be the long-term behavior of this system? 


In some cases the Markov chain reaches an equilibrium state, because the 
state vectors converge to a fixed vector. This fixed vector is called the steady-state 
vector. The most common use of Markov chains is to determine long-term behav- 
ior, so it is important to know if a particular Markov chain has a steady-state 


vector. 
T=] ° 1] ana POH 3 
1 0 an 


4. Let 
Compute enough state vectors to determine the long-term behavior of 
this Markov chain. 


A transition matrix T of a Markov chain is called regular if all the entries in 
some power of T are positive. If a Markov chain has a regular transition matrix, 
then the process has a steady-state vector. One way to find the steady-state vec- 
tor, if it exists, is to proceed as in part 3; that is, calculate enough successive state 
vectors to identify the vector to which they are converging. Another method 
requires the solution of a system of linear equations. The steady-state vector U 
must be a solution of the matrix equation TU = U, and the entries of U have sum 
equal to 1. 


5. Verify that the transition matrix for the weather in Acia is regular and 
that the transition matrix in part 4 is not regular. 


21 <a 
6. Solve E i B = [sp the condition that x + y = 1. Compare 
3. 2 


your solution with the results of part 3. 


7. Consider a plant that can have red (R), pink (P), or white (W) flowers 
depending on the genotypes RR, RW, and WW. When we cross each of 
these genotypes with genotype RW, we have the following transition 
matrix. 


Flowers of parent plant 
R P Ww 
Flowersof R | 05 025 0.0 
offspring Pj}O05 O05 05 
plant Wy o00 0.25 05 


Suppose that each successive generation is produced by crossing only 

with plants of RW genotype. 

a. Will the process reach an equilibrium state? Why or why not? 

b. If there is a steady-state vector for this Markov chain, what are the 
long-term percentages of plants with red, pink, and white flowers? 
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8. In Acia there are two companies that produce widgets, Widgets, Inc., 
and Acia Widgets. Each year Widgets, Inc., keeps one-fourth of its cus- 
tomers while three-fourths switch to Acia Widgets. Each year Acia 
Widgets keeps two-thirds of its customers and one-third switch to 
Widgets, Inc. Both companies began business the same year and in that 
first year Widgets, Inc. had three-fifths of the market and Acia Widgets 
had the other two-fiiths of the market. Under these conditions, will 
Acia Widgets ever run Widgets, Inc., out of business? Justify your 
answer. 


Experiment 7 
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Ways to store and retrieve information in binary trees are presented in Sections 
8.2 and 8.3. In this experiment you will investigate another type of tree that is fre- 
quently used for data storage. 

A B-tree of degree k is a tree with the following properties: 


1. All leaves are on the same level. 
2. If it is not a leaf, the root has at least two children and at most k chil- 
dren. 


3. Any vertex that is not a leaf or the root has at least k/2 children and at 
most k children. 


The tree in Figure 1 is a B-tree of degree 3. 


Figure 1 


PartI. Recall that the height of a tree is the length of the longest path from the 
root to a leaf. 


1. Draw three different B-trees of degree 3 with height 2. Your examples 
should not also be of degree 2 or 1. 


2. Draw three different B-trees of degree 4 (but not less) with height 3. 

. Give an example of a B-tree of degree 5 (but not less) with height 4. 

4. Discuss the features of your examples in parts 1 through 3 that suggest 
that a B-tree would be a good storage structure. 


wo 


Part II. The properties that define a B-tree of degree & not only restrict how the 
tree can look, but also limit the number of leaves for a given height and the 
height for a given number of leaves. 


1. If Tis a B-tree of degree k and T has height h, what is the maximum 
number of leaves that T can have? Explain your reasoning. 

2. If T is a B-tree of degree k and T has height h, what is the minimum 
number of leaves that T can have? Explain your reasoning. 

3. If T is a B-tree of degree k and T has n leaves, what is the maximum 
height that T can have? Explain your reasoning. 

4. If T is a B-tree of degree k and T has n leaves, what is the minimum 
height that 7 can have? Explain your reasoning. 

5. Explain how your results in Part II, questions 3 and 4, support your 
conclusions in Part I.4. 
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Experiment 8 


The purpose of this experiment is to investigate relationships among groups, sub- 
groups, and elements. Five groups are given as examples to use in the investiga- 
tion. You may decide to look at. other groups as well to test your conjectures. 


S; is the group of permutations of {1, 2,3} with the operation of composi- 
tion. It is also the grou of symmetries of a triangle. (See Section 9.4.) 


D, is the group of symmetries of a square. (This group is presented in 
Exercise 17, Section 9.4.) 


S, is the group of permutations of {1, 2, 3, 4} with the operation of com- 
position. 


G, is the group whose multiplication table is given in Table 1. 
G, is the group whose multiplication table is given in Table 2. 


You may find it helpful to write out the multiplication tables of 5, D,, and S,. 


Table 1 


1 2, 3 4 5 6 67 8 
1 1 2 3 4 5 6 7 8 
2 2 5 4 7 6 1 8 3 
3 3 aes) ae j 4 1 6 
4 4 3 6 5 8 7 2 1 
5 5 6 7 8 1 2 3 4 
6 6 . 8 3 2 5 4 cL 
ei 7 4 61 6 3 8 5 2 
8 8 yo 1 4 3 6 5 
Table 2 

1 2 2B 4 5 

1 L 2 3 4 5 

2 2 3 #4 5 61 

3 3 4 5 1 2 

4 45 1 2 3 

5 5 1 2 3 4 


1. Identify the identity element e for each of the five groups. 


2. For each of the five groups, do the following. For each element g in the 
group, find the smallest & for which g* = e, the identity. This number k 
is called the order of g. 

3. What is the relationship between the order of an element of a group 
and the order of the group? (The order of a group is the number of 
elements.) 
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. For each of the five groups, find all subgroups of the group. 

. A group is called cyclic if its elements are the powers of one of the ele- 
ments. Identify any cyclic groups among the subgroups of each group. 
. What is the relationship between the order of a subgroup and the order 
of the group? 


. The groups G, and D, are both of order 8. Are they isomorphic? 
Explain your reasoning. 
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Experiment 9 


Moore machines (Section 10.3) are examples of finite-state automata that recog- 
nize regular languages. Many coraputer languages, however, are not regular (type 
3), but are context free (type 2). For example, a computer language may include 
expressions using balanced parentheses (a right parenthesis for every left paren- 
thesis). A Moore machine has no way to keep track of how many left parenthe- 
ses have been read to determine if the same number of right parentheses have 
also been read. A finite-state machine that includes a feature to do this is called 
a pushdown automaton. 

A pushdown automaton is a sequence (5S, J, F, 5), T) in which S is a set of 
states, T is a subset of S and is the set of final states, s, € S is the start state, 7 is 
the input set, and F is a function from S$ x 7 x J* to S X I*. Roughly speaking, 
the finite-state machine can create a string of elements from the input set to serve 
as its memory. This string may be the empty string A. The transition function F 
uses the current state, the input, and the string to determine the next state and 
the next string. For example, F(;, a, w) = (s,, w’) means that if the machine is in 
state s, with current memory string w and a is read, the machine will move to 
state s, with new string w’. In actual practice there are only two ways to change 
the memory string: 


(1) From w to bw for some b in J; this is called pushing b on the stack. 
(2) From bw to w for some b in J; this is called popping b off the stack. 


A pushdown automaton accepts a string v if this input causes the machine to 
move from sp) with memory string A to a final state s; with memory string A. 


1. Construct a Moore machine that will accept strings of the form 01”, 
m,n = 0, and no others. 

2. Explain why the Moore machine in part 1 cannot be modified to accept 
strings of the form 0"1”, n = 0, and no others. 

3. Let P = (S,1, F, 59, 7) with S = (so, 5,}, 7 = {0,1}, T = {s,}, and 

F(S,0, w) = (Sp, Ow), F(Sq, 1, Ow) = (8, w), F(s,, 1, Ow) = (5), w) 
where w is any string in .. Show that P accepts strings of the form 0”1", 
n = 0, and no others. 

4. Let J = {a, b,c} and w & {a, b}*. We define w®* to be the string formed 
by the elements of w in reverse order. For example, if w is aabab, then 
w® is babaa. Design a pushdown automaton that will accept strings of 
the form wew®, and no others. 


5. Let G = (V, S, sy, +») be a phrase structure grammar with V = 
{v, w, a, b, c}, S = {a, b,c}, and 


be Vy > avd, Vob & bw, abwiic 


a. Describe the language L(G). 
b. Design a pushdown automaton whose language is L(G). That is, it 
only accepts strings .n L(G). 
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Experiment 10 


Suppose that there are n individuals P,, P;,..., P,, some of whom can influence 
each other in making decisions. If P, influences Ps, it may or may not be true that 
P,; influences P;. In Figure 1 we have drawn a digraph to describe the influence 
relations among the six members of a design team. Notice that the digraph has 
no loops; an individual does not influence herself or himself. 


Ps 


Figure 1 


1, a. Give the adjacency matrix for this relation. 
b. Is there a leader in this design group? Justify your answer. 


The relation described by the digraph in Figure 1 is not transitive, but we 
can speak of two-stage influence. We say P has two-stage influence on P if there 
is a path of length 2 from F to P. Similarly, PF has r-stage influence on P if there 
is a path of length r from F to P. In Section 4.3, a method for determining 
whether a path of length r exists from P, to P, is presented. 


2. Use the adjacency matrix for the relation described by Figure 1 to 
determine whether P, has two-stage influence on F for each ordered 
pair of distinct members of the design team. 


3, Consider a communication network among five sites with adjacency 


matrix 
01 0 0 0 
0 0 1 0 1 
00 0 1 #0 
110 0 0 
00 1 1 =0 


a. Can P; get a message to P; in at most two stages? 

b. What is the minimum number of stages that will guarantee that 
every site can get a message to any other different site? 

c. What is the minimum number of stages that will guarantee that 
every site can get a message to any site including itself? 


A dictionary defines a clique as a small exclusive group of people. In study- 
ing organizational structures, we often find subsets of people in which any pair of 
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individuals is related, and we borrow the word clique for such a subset. A clique 
in an influence digraph is a subset S of vertices such that 


(1) |S) =3. 
(2) If F and P are in S, then F influences P and P influences P. 
(3) Sis the largest subset that satisfies (2). 


4. Identify all cliques in the digraph in Figure 2. 


Ps 


Figure 2. 

If the digraph is small, cliques can be identified by inspection of the 
digraph. In general, it can be difficult to determine cliques using only the digraph. 
The algorithm CLIQUE identifies which vertices belong to cliques for an influ- 
ence relation given by its matrix. 


ALGORITHM CLIQUE 

1. If A = [a;,;] is the adjacency matrix of the influence relation, construct 
the matrix S = [s,,] as follows: s,, = s;, = 1 if and only if a, = a;; = 1. 
Otherwise, s,, = 0. 

2. Compute SOS OS = C = [c,]. 

3. P; belongs to a clique if and only if ¢;, is positive. 

END OF CLIQUE 


5. Use CLIQUE and the adjacency matrix for the digraph in Figure 2 to 
determine which vertices belong to a clique. Verify that this is consis- 
tent with your results for part 3. Explain why CLIQUE works. 

6, Five people have been stationed on a remote island to operate a weather 
station. The following sccial interactions have been observed: 

P, gets along with P,, P3, and P,. 
P, gets along with P,, P3, and Ps. 
P, gets along with P,, P,, and P,. 
P, gets along with P; and Ps. 
P, gets along with P,. 
Identify any cliques in this set of people. 
7. Another application of cliques is in determining the chromatic number 


of a graph. (See Section 6.4.) Explain how knowing the cliques in a 
graph G can be used to find X(G). 


ANSWERS TO 
ODD-NUMBERED 
EXERCISES 


Chapter 1 
Exercise Set 1.1, page 4 
1. (a) True. (b) False. (c) True. 
(d) False. (e) True. (f) False. 
3. (a) {A, R, D, V, K}. (b) {B, O, K}. 
(c) {M,1,S, P}. 
5. (a) {x |x is a positive even integer less than 12}. 


n 


\o 


11. 


(b) {x |x is a vowel}. 
(c) {x |x = y? and y € {1, 2,3, 4, 5}. 
(d) {x|x © Zand x? <5}. 


(b), (€), (e)- 


. { }, {BASIC}, (PASCAL), {ADA}, (BASIC, 


PASCAL}, [BASIC, ADA}, {(PASCAL, ADA}, 
{BASIC, PASCAL, ADA}. 


(a) True. (b) False. (c) False. 
(d) True. (e) True. (f) True. 
(g) True. (h) True. 


Baa oa © de 
@eg fc 

15. (a) False. (b) True. (c) False. 
(d) True. (e) True. (f) False. 

17. (a) {{ }, (3), (7), {2}, (3, 7), (3, 21, {7, 2b, (3, 7, 2h}. 
(b) 3. () 8 


19. OCZACNCZCR. 


Exercise Set 1.2, page 12 


1. (a) {a, b, c,d, e,f, g}- (b) {a, c,d, e, f, a}. 


(c) {a, ¢}. (d) {f}. 
(e) {a, b, c}. (f) {d,e,f,h, k}. 
(g) {a, b,c, d, e, f}. (h) (5. gf}. 

3. (a) {a, b,c, d,e,f, g}. (b) { }. 


(d) {a,, f}. 
(f) (a,b,c, d,e,f,h, kh. 


(c) (a,c, g}. 
(e) (2, 4}. 
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478 Answers to Odd-Numbered Exercises 


1. 


13. 


15. 


17. 


19. 


21. 


(a) {1,2, 4,5, 6, 8, 9}. (b) {1, 2, 3, 4, 6, 8}. 
(c) {1, 2, 4, 6, 7, 8}. (d) {1, 2,3, 4,5, 9}. 
(e) {1,2, 4}. (f) {8}. 
(g) {2,4}. (h) {}. 
{i) {1,6, 8}. Q) {5,9}. 
(k) {1,2, 3, 4}. () {5, 6,7, 8, 9}. 
(m) (3, 5, 7, 9}. (n) {1,6, 8,5, 9}. 
(0) {1, 2, 3, 4, 7, 8}. (p) {5, 9, 3, 1}. 

» (a) {b,d, 2, A}. (b) {b, c,d, f. g, h}. 
(c) {b,d, h}. (d) [b,¢,d,e,f, gh}. 
(e) {}. (f) {c.f 8t- 


. (a) All real numbers except —1 and 1. 


(b) All real numbers except —1 and 4. 
(c) All real numbers except —1,1, and 4. 
(d) All real numbers except —1. 


(a) True. (b) True. (c) True. 
(d) False. 


B must be the empty set. 
(a) 116. (b) 60. 


(a) 162, (b) 118. (c) 236. = (d) 290. 
(e) 264. 


Let x € AM B.Then x € A and x € B. Thus 
each element of AN BisinAandAN BCA. 


Cc 


. (a) (b) Letx EA UB. 


A Then x € A or 
x €B.Since ACC 
& andBCC,xEA 
or x € B means 


that x € C. Hence 
AUBCC. 


. Suppose that x € A — B.Thenx € A and x € B. 


Thus x € A and x € B,sox € A M B. We have 
A - BGAN B.Nowchoose any y€ AM B. 
Theny © A andy € Bsoy€ A andy € B. 
This means thaty EA —- Band ANBCA-—B. 
HenceA-B=ANB. 


27. 


29. 


No. Let A = {1, 2, 3}, B = {4}, and C = {3, 4}. 
ThenAUB=AUCandBFC. 


(a) Letx EAU C.Thenx €Aorx EC,s0 
x € Borx € Dandx € B U D. Hence 
AUCCBUD. 

(b) Letx € ANC. Then x € A and x € C,so 
x © Bandx € D. Hence x € BN D. Thus 
ANCCBND. 


Exercise Set 1.3, page 21 


1. 


3. 


5. 


19. 


21. 


we, 


(1, 2}. 
{a, b,c,..., z}. 


Possible answers include xyzxyz ..., 
XXVyZZXXyyZzZ, and yZxyZV.... 


- 5,25, 125, 625. 
. 2.5, 4, 5.5, 7. 


+ Q, = 4,1 + 2,a, = 1 recursive. 


C, = (-1)"*! explicit. 


1 = &,-1 + 3,e, = 1 recursive. 


. a, = 24+ 3(n - 1). 


A, uncountable; B, finite; C, countable; D, finite; 
E, finite. 


(a) 01101110. — (b) 01100000. 
(c) 00100000. (d) 11111011. 
(e) 00010100. 


ifxE€AOB 


1 
faastt) = {fh ifx¢A@B’? 


ih taye 1 ifx€AUBandx €ANB 
AGB 0 ifx€AUBorxE ANB 


Ifx AU Bandx EAN B, Six) + fax) - 
2fx(x)fg(x) =1-0=1. Ifx EAU Bor 
xEANB, fylx) + fa) — 2f4C) fg) = 
1+1-2-1-1=00r0+0-2:-0=0. 


27. 


29. 


On the other hand, 
Fax) + fox) — 2f,0)fg(%) = 0 only if 


F(x) + fa) = 2fa(2)fa(%) only if f(x) = fy (2). 


If f,(x) = fa(x) = 1 thenx € A © B; if 
fa(x) = f(x) = 0, then x ¢ A and x € B,so 
xE€AQ@B. 


. (a) aand 6 are regular by RE2. ab is then reg- 


ular by RE3 and so by RES, (ab)* is regu- 
lar. Applying RE2 and RE3, we have 

a + b(ab)* and a X bare regular. By 
RE4, (a X b V a) is regular. Using RE3, 
a+ b(ab)*(a X b V a) is regular. 

(b) By RE2, a,b, +, X are regular. By RES, a* 
is regular; (a* V b) is regular by RE4. 
Using RE3, we have a + b X (a* V b) is 
regular. 

(c) By RE2, a, b, V, + are regular. Thus, by 
RES, a* and b* are regular. Using RE3, we 
have a*b and X ab* are regular. By RE4, 
(a*b V +) is regular. By RES, (a*b V +)* 
is regular. And finally, by RE4, 

((a*b V +)* V X ab*) is regular. 


T-numbers form the sequence 0, 3, 6, 9,....The 
T-numbers are the nonnegative multiples of 3. 


0,1,1,3,5, 11. 


Exercise Set 1.4, page 29 


1 20=6-3+2., 

3.3 =0:22 43. 

5, (a) 828 = 27-37-23, (b) 1666 =2- 7+ 17, 
(c) 1781 =13-137. — (d) 1125 = 3?- 5%, 
(e) 107. 

7. d=3,3=3:-45 —4- 33. 

9. d=1; 1 =5-+-77 —3- 128, 

11. 1050. 

13. 864. 


15. 


17. 


19. 


21. 


23. 
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(a) (3,9, 15,21,...}.  (b) (1, 7, 13, 19... }. 

If GCD(a, c) = 1, there are integers s, t such that 
1 =sa + tc. Thus b = sab + tcb. Since c| ab and 
c|¢, we have c | (sab + tcb). That is, c| b. 


Since a| b and c| b,ac | ab and ac | bb. We can 
write d as sa + tb and bd = sab + tbb. Because 
ac divides both sab and tbb, ac also divides bd. 


Clearly, a | am and am | am, so am is a common 
multiple of a and am. No smaller multiple of 
am exists, so am = LCM(a, am). 


Let a = pip? «++ pi", b = pip? --- pp", and 
k = pip... pk» where some of the 

a,, b,, and k, may be zero. Since a| k, k, = 4,, 
i=1,2,...,n and since b|k,k, = 6,, 
i=1,2,...,2.If¢ = LCM(a, b), then 

c = pip? --+ ps, where c; = max(a,, b;). Then 
k,2 ¢3i =1,2,...,nande|k. 


. p|aand p | p, so p is a common divisor of a and 


p. Hence p | GCD(a, p). But GCD(a, p) 
GCD(a, p) = p. (See Exercise 24.) 


P, SO 


Exercise Set 1.5, page 37 


1. 


3. 


5. 


(a) —2,1,2. 
(d) 2, 6,8. 


(b) 3,4. (c) 4,-1,8. 


ais 3, bis 1,c is 8, and dis ~2. 


hh 213 
(a) (b) ap=|_! it 


Wok 
NAO 


1 32 
3 -14. 
5 0 


. 21 14 
(c) Not possible. (d) i al 


7. (a) EBis 3 X 2 and FA is 2 X 3; the sum is 


undefined. (b) B + D does not exist. 
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9. 


11. 


13. 


15. 


17. 


19. 


21. 


10 O -25 : 
©) Fi 1 | (d) DE does not exist. 


4 12 
22 «34 
(a) 3 11}. 
-31 3] 


(b) BC is not defined. 
25 5 26 
() i -3 aI 
(d) D? + E is not defined. 


mm 
Let B = [b;,) = I,,A. Then by, = >, i,/4,, for 
f=1 


1<j<=mand1<k <n, Buti, = 1 andi, =0 


ifj #1. Hence b, = ia,,,1Sjsm1lsken. 


d 


This means B = I,,A = A. Similarly, if C = 
n 
AI, = [cal Cj = 2 jin, = Aging = x for 


lsjsm1lskesn, 


27 0 0 3 0 0 
Ab=| 0 -8 O}orl]oO (-2~ 0], 
0 0 64 0 o 4 
3K ft) tt) 
Ak=|0 (-2)* 0 
i) i) 4 


The entries of If satisfy i= i,. But i,= 1 if 
j = k and is 0 otherwise. Thus i,,= 1 if k = j 
andisQifk #jforlsjsn,1sksn. 


n 
The jth column of AB has entries c,, = Sanh, i 
k=1 


Let D = [d,,) = AB,, where B, is the jth column 


ay? 


of B. Then d= >) @inbmnj = € 
m=1 


1 0 
welt i] =a. 


(a) (A + B)’ = A’ + B? by Theorem 3. Since 
A and B are symmetric, A’ + B’ = A+B 
and A + B is also symmetric. 


(b) (AB)? = B’A’ = BA, but this may not be 
AB, so AB may not be symmetric. Let 


1 2 3-1 
A= E A and B = be 3 men 
AB is not symmetric. 


23. (a) The i, jth element of (A’)® is the j, ith ele- 

ment of A’. But the j, ith element of A’ is 
the i, th element of A. Thus (A’)’ = A. 

(b) The i, jth element of (A + B)’ is the j, ith 
element of A + B,a,; + b;;. But this is the 
sum of the j, ith entry of A and the j, ith 
entry of B. It is also the sum of the i, jth 
entry of A? and the i, ;th entry of B’. Thus 
(A + B)? = A? + BY” 

(c) Let C = [c,,] = (AB). Then c,, = 


>d ajxb,;, the j, ith entry of AB. Let 
k=1 
nt 
D = [d,) = B'A’, then d;, = >) b,aj,= 
k=1 


n n 
> Dyin = >» 4jpD 4 = Cj, Hence 
k=1 k= 


(AB)? = B’A™. 
25, (a) Let B = [b,] = AV A.b “1 ae 
7“ W 0 a,; = 0. 
Hence B= A, 
oe bl 
(b) Let B = [b,)= AAA.6,,= i ae 
ip 
Hence B= A. 


27. No solution is given. 
nm 
29. Since cy = Danby and k | a,, for any i and t, 
t= 


k divides each term in c,,, and thus k le; j for alli 
and j. 


Exercise Set 1.6, page 43 


1. (a) Yes. (b) Yes. (c) Yes. (d) No. 


3. A@B={x|(xE AU B)andx EAN B= 
{el(e E BU A)and (x EBN A)}=BO@A. 


7. 


11. 


13. 


17. 


19. 


a 0} Jo 9) Jats 
“lo 0 0 0 0 
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x yy 2 yOz | xVQQz) xVy [xVz] &VyO@Vvz) 
0 0 0 0 0 0 0 0 
0 0 1 1 0 0 0 0 
0 1 0 1 0 0 0 0 
0 1 1 0 0 0 0 0 
1 0 0 0 0 0 0 0 
1 0 1 1 1 0 1 1 
1 1 0 1 1 1 0 1 
1 1 1 0 0 1 1 1 
(A) (B) 
Chapter 2 


Since columns (A) and (B) are identical, the 
distributive property x V(vOz)=@Vy)O 
(x V z) holds. 


5 x 5 zero matrix for V; 5 X 5 matrix of 1’s 
for /\; I, for ©. 


. Let A, B be n X n diagonal matrices. Let 


n 
[c,] = AB. Then c, = >) a;,b,; but a, = Oif 
k=1 


i# k. Hence ¢,, = a,,b,;. But b; = Oif i # j. 
Thus ¢,, = Oifi # j and AB is ann Xn 
diagonal matrix. 


Yes, the n X n zero matrix, which is a diagonal 
matrix. 


—A is the diagonal matrix with i, ith entry —a,,. 


3 belongs 


to M. 
di 
[; a or E 7 belongs to M. 


1 0O bod 
Yes, | 0 | . By Exercise 16, we see this is the 


identity and1 ER. 


Exercise Set 2.1, page 51 


1. (b), (d), and (e) are statements. 


3. (a) 3+1<S5and7=3-6. 
3+1<Sor7=3:-6. 
(b) Iam rich and I am happy. 
Iam rich or I am happy. 
(c) I will drive my car and I will be late. 
I will drive my car or I will be late. 


5. (a) True. 
(d) False. 


(b) True. (c) True. 


7. (d) is the negation. 


9. (a) The dish did not run away with the spoon 
and the grass is wet. 
(b) The grass is dry or today is Monday. 
(c) It is not true that today is Monday or the 
grass is wet. 
(d) Today is Monday or the dish did not run 
away with the spoon. 


11. (a) For all x there exists a y such that x + y is 
even. 
(b) There exists an x such that, for all y, x + y 
is even. 


13. (a) It is not true that there is an x such that x is 
even. 
(b) It is not true that, for all x, x is a prime 
number. 
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15. 10 (a) False. (b) True. 11 (a) True. (b) False. 
12 (a) False. (b) True. 13 (a) False. (b) True. 


17. (a) p q pVqr 
T T T T/T 
T T F TI/F 
T F T T|T 
T F F T/F 
F T T T|T 
F T F T/F 
F F T F|F 
F F F FIF 
(1) T 
(bt) pg or | ~pVqh~r 
T T T TIF 
T T F T,T 
T F T F] F 
T F F F | F 
F T T T|F 
BE T F T| T 
F F T T|F 
F F F Ti T 
(1) T 
19. p q r plaApvr 
T T T F/F/F 
T T F F/F/F 
T F T FF /F 
T F F FFF 
F T T FI/F JF 
FE T F i saan We ca Oe 
F F T T|F/F 
F F F TITIT 
(1) 7 @) 


Exercise Set 2.2, page 57 


L(@poq (b)roap. (©) qnp. 
(d) ~rap. 


3. (a) If] am not the Queen of England, then 

24+2=4, 

(b) If I walk to work, then I am not the 
President of the United States. 

(c) If I did not take the train to work, then I 
am late. 

(d) If I go to the store, then I have time and I 
am not too tired. 


17. 


(e) If I buy a car and I buy a house, then I have 
enough money. 


5. (a) True. (b) False. (c) True. 
(d) True. 


7. (a) If I don’t study discrete structures and I go 

to a movie, then I am in a good mood. 

(b) If I am in a good mood, then I will study 
discrete structures or I will go to a movie. 

(c) If 1am not in a good mood, then I will not 
go to a movie or I will study discrete struc- 
tures, 

(d) I will go to a movie or [ will not study dis- 
crete structures if and only if I am ina 
good mood. 


9. Yes. If p > q is false, then p is true and q is 
false. Hence p /\ q is false, ~ (p /\ q) is true, 
and (~ (p \q)) > @ is false. 


11. p q pq piplalq 
T T T F/T YF 
T F F F)F IT 
FE T F T| FF 
F F F TIFIT 
(A) (B) 


Since columns (A) and (B) are the same, the 
statements are equivalent. 


13. (a) (i). (b) (iv). 
1. p @q |~@Aq)|~pV~a 
T T |FIT F|FIF 
T F |T\F FITIT 
F T|TIF TIT|F 
F FfITIF TITIT 
(A) (B) 


Because columns (A) and (B) are the same, the 
statements are equivalent. 


(PAQ)—>P 


dda] 
dH dH) 
~aH4Hs 


(p\(p>q))>4 


toag|s 
Ayes) s 
Saas 


Exercise Set 2.3, page 63 
1. Valid: ((d> )A~ > ~d. 


3. Invalid. 
5. Valid: ((f V ~ w) Aw) f. 
7. Valid: [(ht > m) A (m hp)] > [~hp > ~ht]. 


9. (a) Suppose that m and n are even. Then there 
exist integers j and k such that m = 27 and 
n= 2k.m«n = 2j * 2k = 2(2jk). Since 2jk 
is an integer, m * n is even and the system 
is closed with respect to multiplication. 

(b) Suppose that m and n are odd, Then there 
exist integers j and k such that m = 27 + 1 
andn = 2k + 1.m*en=2j*2k + 2+ 
2k + 1 = 2(2jk + j + k) + 1. Since 2jk + 
j + kis an integer, m * n is odd and the sys- 
tem is closed with respect to multiplication. 


11. If A = B, then, clearly, A C Band BC A. If 
AC BandBCA,thenACBCAandB 
must be the same as A. 


13. (a) {AC B,thenAUBCB.BuBCAUB. 
Hence A U B = B.If A U B = B, then, 
since A C A U B,we have A C B. 

(b) fA CB, thenA CAN B.BUAN BCA. 
Hence AM B= A. If AN B = A, then, 
since AM BC B,wehaveA CB. 


15. Any five consecutive integers can be represented 
by n,n +1,n+ 2,n + 3,n + 4. Their sum is 
Sn + 10 or S(m + 2). This is clearly divisible by 5. 


3 2 et 
17. For x = }, we have (3) < () . This is a coun- 
terexample. 
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19. We give a proof by contradiction. Let 4 1 J, 
and /, 1 1. If l, and J, intersect, then there is a 
triangle formed with two right angles. This is 
not possible in Euclidean geometry. Thus /, and 
1, cannot intersect. 


Exercise Set 2.4, page 68 


Note: Only the outlines of the induction proofs are 
given. These are not complete proofs. 


1. Basis step:n = 1 P(1):2(1) = 1(1 + 1) is true. 
Induction step: P(k):2 + 4+ +--+ + 2k = 
k(k + 1). 
P(k +1):24+44+-°°+2(k +1) = 
(k + 1)(k + 2). 
LHS of P(k+1):2+44+--°+2k + Ak+1)= 
k(k + 1) + 2(k + 1) = (kK + 1)(k + 2) 
RHS of P(k + 1). 


3. Basis step:n = 0 P(0):2° = 2°*! — 1 is true. 
Induction step: LHS of P(k + 1):1 + 2! + 2? + 
oo oka geele (2k va 1) ide Okt] = 


2-21 1 =2'+2_ 1 RHS of P(k + 1). 


1. + ne ae 


5. Basis step:n = 1 P(1): 1? = 


true. 
Induction step: LHS of P(k + 1): 17+ 2? + 


k(k + 1)(2k + YD, 
6 


eet (k+1P= 


k(2k + 1) 


(kK + 1P =(k +1) +a +0)= 


EAT (012 + k + 6k +1) = 


bt Los mga tt Des Heke): 
(e+ 1k +1) + AE +1) +1) pag of 

6 
P(k + 1). 


7. Basis step:n = 1 P(1):1 = 1(2-1 — 1) is true. 
Induction step: LHS of P(k + 1):1+5+9+--: 
+ (4k ~ 3) + (4(e + 1) - 3) = kk - 1) t+ 
A(k +1) —3= 2k? + 3k +1 =(k + 1)(2k +1) 
= (k + 1)((kK +1)-— 1) RHS of P(k + 1). 
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9. 


11. 


17. 
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_,l 
Basis step:n = 1 P(1):a= wat 
Induction step: LHS of P(k + 1):a + ar+::: 
_ yk 
+ ark) + ark = agi t+ ark = 
1-r 

a — ar® + ar® — ar*** — a(l — ré*4) 

1l-r 1l-r 
RHS of P(k + 1). 


is true. 


Basis step:n = 2 P(2):2 < 2’ is true. 
Induction step: LHS of P(k + 1):k+1< 
2F+1<2'+2k=2-2k=2'*! RHS of 
P(k + 1). 


. Basis step:n = 0 A ={}and P(A) = {},so 


|P(A)| = 2° and P(0) is true. 

Induction step: Use P(k): If !A| = k, then 

| P(A)| = 2* to show P(k + 1):If|Al =k +1, 
then , P(A), = 2**1. Suppose that |A|= & + 1. 
Set aside one element x of A.Then|A — {x}] = 
k and A — {x} has 2* subsets. These subsets are 
also subsets of A. We can form another 2* sub- 
sets of A by forming the union of {x} with each 
subset of A — {x}. None of these subsets are 
duplicates. Now A has 2* + 2*, or 2**}, subsets. 


. Basis step:n = 1 P(1): A, = A, is true. 


Induction step: LHS of P(k + 1): 
K+1 k 
NA; -| nal Aga 

i=1 


i=1 


k 
(A; U A,,, (De Morgan’s laws) 
i=l 


k . oa k+l | 
(va) UA,., = UA, RHS of P(k + 1). 
i=l 


i=1 


Basis step:n = 1 P(1): A, U B = A, U Bis true, 


Induction step: LHS of P(k + 1): 
k+1 k 
(A\4] UB= ((n4) ia Aes} UB 


i=1 i=1 
k 

= ((n4] U a| NM (Ay,,U B) (distributive 
i=1 

property) 
k k+l 

(Aw, U a) M (Ags, UB) = 11 (A; U B) 
i=1 i=1 


RHS of P(k + 1). 


19. 


21. 


23. 


25, 


27. 


29. 


Basis step:n = 1 P(1): A? = Aj is true. 
Induction step: LHS of P(k + 1): (A; + A, + 
so + A, t+ Ay)? = (Ay t+ Apt + AYP t+ 
AT,,=Af>+AJ+°:-+A/+A7,, RHS 
of P(k + 1). 


Basis step:n = 1 P(1): A°- A = A?*? is true. 
Induction step: LHS of P(k + 1): A?+ Ak*? = 
AXA‘. A) = (A? AS) A= APtRO A = 
A2***1 RHS of P(k + 1). 


Basis step:n = 1 P(1): (AB)! = A! - B1is 
true. 

Induction step: LHS of P(k + 1): (AB)**? = 
(AB)(AB)‘ = AB - A‘B‘ = BA - A*BE = 

A- A‘ B- BF = A‘*!. Bt! RHS of P(k + 1). 


Basis step:n = 1 P(1): If GCD@@, 6) = 1, then 
GCD(a’, 5’) = 1 is true. 

Induction step: Suppose that GCD(a, b) = 1. 
Let d = GCD(a**?, b**'). If d # 1, then let 

p be a prime factor of d. Then p | a**! and 
p\b**}, By Exercise 24, p | a and p | b. But this 
is a contradiction. Hence d must be 1. 


Loop invariant check: 

Basis step:n =0 P(0): YX W,+ Z)= 

X + Y’ is true because W, = Y and Z, = X. 
Induction step: LHS of P(k + 1): ¥ X Wy4, + 
Zea = YX (W,- 104 (Z, 4+ YD = 
Y¥YXW,+Z,=X+Y* RHS of P(k + 1). 
Exit condition check: When W = 0, ¥ X W+ 
Z=X+Y’ yields Z = X+ ¥?. 


Loop invariant check: 

Basis step:n = 0 P(0): Ry x N¥o = N2™ is 
true, because R, = 1 and Ky = 2M. 

Induction step: LHS of P(k + 1): 

Ry X Net = (Ry XN) X N¥eod = 

R, X N&i = N?™ RHS of P(k + 1). 

Exit condition check: When K = 0,R x NK = 
N™™ yields R X N° = N™ or R = N74, 
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Exercise Set 3.1, page 77 


1. 


3. 


67,600. 


16. 


5, 1296. 


7. (a) 24. (b) 120. (c) 720. 


9. (a) 479,001,600. (b) 1,036,800. 
11. 240. 

13. (a) 4,989,600. (b) 39,916,800. 
15. 336,000. 


17. n+, :P,-,=n+(n- Wn - 2) 21 = 
n! = ,P,. 


19. 180. 


Exercise Set 3.2, page 81 


1. (a) 1. (b) 35, (c) 4368. (d) nt. 
n! (n + 1)! 

3. 980. 

5. 5,096,520. 


7. 171,028,000. 


9. (a) 56. (b) 21. (c) 980. (d) 1176. 
11. 177,100. 
B.C, +,C.= a ‘ 
Somer wr r= 1M = (r — 1)! 
n! _ nirtnl(n — r+1) _ 
ri(n — ry! ri(n — r+1)! 
n(n + 1) (n + 1)! 
= ntiCy 


An+1—n! Ant+i—y! 
15. (a) 32. (b) 5. (c) 10. 
17. (a) 2". 


(b) Cx (€) Cy 


19. $25. 


Exercise Set 3.3, page 85 


1. Let the birth months play the role of the 


pigeons and the calendar months, the pigeon- 


3. 


w~ 


7. 


9. 


11 


13. 


15. 
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holes. Then there are 13 pigeons and 12 pigeon- 
holes. By the pigeonhole principle, at least two 
people were born in the same month. 


™m,M, m, are the midpoints of sides AC, AB, 
and BC, respectively. Let the four small trian- 
gles created be the pigeonholes. For any five 
points in or on triangle ABC, at least two must 
be in or on the same small triangle and thus are 
no more than § unit apart. 


By the extended pigeonhole principle, at least 
L(50 — 1)/7] + 1 or 8 will be the same color. 


Let 2161 cents be the pigeons and the six 
friends, the pigeonholes. Then at least one 
friend has (2161 — 1)/6] + 1 or 361 cents. 


If repetitions are allowed, there are ,,C, or 4368 
choices. At least |4367/175] + 1, or 25, choices 
have the same cost. 


‘You must have at least 49 friends. 


Label the pigeonholes with 1, 3,5,...,25, the 
odd numbers between 1 and 25 inclusive. 
Assign each of the selected 14 numbers to the 
pigeonhole labeled with its odd part. There are 
only 13 pigeonholes, so two numbers must have 
the same odd part. One is a multiple of the 
other. 


No. At least one pair of the 12 cards must add 
up to 21. 


Exercise Set 3.4, page 92 


1. 


3. 


5. 


{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}. 


(mly, min, may, man, muy, mun, fly, fin, fay, fan, 


fuy, fun}. 


{sb, sr, sg, cb, cr, cg}. 
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7. (a) (}, {1 (2), Bh {2,3}, {1,2}, (1, 3}, (1,2, 3}. 
(b) 2", 


9, (a) The card is black or is an ace. 
(b) The card is a black ace. 
(c) The card is a red ace. 


(d) The card is black or a diamond or an ace. 


(e) The card is black or not a diamond or an 
ace. 


11. (a) No, 3 satisfies both descriptions. 
(b) No, 2 satisfies both descriptions. 
(c) Yes, EU F = (3,4,5, 1,2, 3}. 
(d) No, EN F = {3}. 


13. (a) {dls, din, dms, dmn, dus, dun, als, ain}. 
(b) {als, ain}. (c) {dis, din, als, ain}. 


15. {a}, {e}, {i}, {0}, {u}. 
ai Or O©O# We 
19. (a)0.7.  (b) 0 (©) 07 (d) 1. 


21. p(A) = 7, p(B) = 3, P(C) = ft PD) = H- 


25. (a)2. (bt. ok (dd) 1. 
ye 9. 


27. 8h 


29. (a) iy (b) ie 


Exercise Set 3.5, page 98 
1. Yes, degree 1. 


3. No. 
5. No. 
7. a, = 4(2.5)"). 


n(n + 1) 


2 6, = 34+ 
Dc, ) 


11, e, = —2(n — 1). 


8 an 20 Ht 
13. 4, = 35 °5 30° 1)". 
15. c, = (3) + 22 a(-3 


17, e, = 2(V2y" + (-V2)". 


: 


n-1_ 
19. a, =r" "a, + (+) 


Chapter 4 


Exercise Set 4.1, page 105 


1. (a) xis 4. (b) y is 3. (c) x is 2. 
(d) yise + 1; x is PASCAL. 


3. (a) {(a,4), (4,5), (a, 6), (6, 4), (b, 5), (6, 6)}.- 
(b) {(4, a), G, a), (6,4), (4,5), (5, b), (6, 6}. 
(c) {(a, 4), (a,b), (b, a), (b, 5D}. 

(d) {(4, 4), 4, 5), (4,6), 5, 4), 6, 5), G, 6), 
(6, 4), (6, 5), (6, 6}. 


5. (a) 6. (b) ms, mm, ml, fs, fm, fl. 


7. (a, 1, #), (a, 1, *), (a, 2, #), (a, 2, *), (b, 1, #), 
(b, 1, *), (b, 2, #), (6, 2, *), (¢, 1, #), (c, 1, 4), 
(c, 2, #), (c, 2, *). 


9. (a) 
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(b) y 5. Domain {1,2,3,4,8}], Range {1, 2,3, 4, 8}; 
10 0 0 0 
(3,5) 01 0 0 0 
0 0 1 =O OF. 
eo at seu 00 01 0 
4,0) ot 00001 


i & & 


3, -4) 


11. By Theorem 2, Section 3.1, the number of ways 
to form an ordered triple in A, X A, X A; is 


Ny + y+ Ny. 7. Domain {1,2,3,4,6},Range {1,2,3, 4, 6}; 
1 00 0 0 
13. (a) Yes. (b) No. (c) Yes. (d) No. 110141 
1 0 1 0 Tf. 
15, (a) {{0,3,9, 15, 21,.. ; {6, 12, 18,.. J}. 1001 0 
(b) {{x|x = Oo0r3+54,k =O}, {x|x = 3-24, 10001 


k= 1}, {x |x = 34,0 # 2* and t # 5* for any 
integer k}}. 


17. {{a}, {5}, tel, {a}. {la}, (., a}, {tb} {a,c all, 
{{c}, {a, b, aj}, {a}, {a, b, ch}, {fa, 5}, {c, dl}. {a,c}, 
{b, dj}, {{a, 2}, {5, cH}, (fa, b,c, dj}, tla}, 5), 
te, d}}, {la}, tc}, (5, a}, {la}. {a}, (b, ch}. 
Ht}, te}, {a, dH (1), {a}, (a,c), (tel, ta}, fa, bY}. 


19. Let (x,y) EA X (BU C).Thenx EA, 
y © BUC. Hence (x,y) € A X Bor 


(x,y) AX C.ThusA X(BUC)C 9, Domain (3,5,7,9],Range {2, 4,6, 8}; 
(A X B)U(A XC). 000 0 
1 0 0 0 
Exercise Set 4.2, page 115 1 1 0 Of. 
: 7 2s 1 11 0 
1. No. No. Yes. 
(a) (i) No (ii) No (iii) Yes. ea a 


(iv) Yes. (v) Yes. (vi) Yes. 
(b) (i) Yes. (ii) No. __(iii) Yes. 
(iv) No. (v) Yes. (vi) No. IL. (a) No. (b) No. (c) Yes. ~—(d) Yes 
(e) No. (f) No. 
3. Domain {IBM, Dell, COMPAQ, Gateway}, 
Range {750C, 466V, 450S V, PS60}; 


nae Ger ae ak 13. Dom(R) = [-5, 5], Ran(R) = [~5, 5]. 


. (a) {1,3}. (b) {1,2,3,6}. (©) {1,2,4,3, 6}. 


oooco 
ooo oc O° 


0 
0 
1 
0 


oo or 
oooo 
oo oo 
ooroeo 


17. aR bif and only if0 <a=<3 and0<b <2. 
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19. R= {(1,1), C1, 2), (1, 4), (2,2), (2, 3), 3, 3), 
(3, 4), (4, 1)}. 


21. R = {(1,2), (2, 2), (2,3), 3,4), (4,4), (5, 1), (5, 4}. 
0 0 0 0 


rPooor 
ooor 
— ee © 
ooo 0 


1 
0 
0 
0 


23. (a) Vertex 
In-degree 


Out-degree 


(b) Vertex 


In-degree 
Out-degree 


NNN NN] ty 
ON|[W Re lw 
WN] Bw] pe 
Or l]mM NO|A 


1 
1 
1 
1 
1 
3 


25, 


S| =6,'S x S| = 36, 


P(S X S)| = 2°. 


Exercise Set 4.3, page 122 
1.1,2 1,6 2,3 3,3 3,4 43 4,5 41 61. 


3. (a) 3,3,3,3 3,3,4,3 3,3,4,5 3,4,1,6 
3,4,1,2 3,4,3,3 3,4,3,4 3,3,4,1 
3,3,3,4. 

(b) In addition to those in part (a), 1,2, 3,3 
1,2,3,4 1,6,4,1 1,6,4,5 2,3,3,3 
2,3,3,4 2,3,4,3 2,3,4,5 4,1,2,3 
4,1,6,4 6,4,3,3 6,4,3,4 6,4,1,2 
6,4,1,6 1,6,4,3 2,3,4,1 4,3,3,3 
4,3.4,3 4,3,4,1 4,3,4,5. 


Pooroeo;9s 
oor,rcoo 
POR PrP re 
Cor rR ee 
Poor Oo Oo 
oorooc°o 


9, a,c a,b b,b b,f c,d c,e d,c d,b 
ef fd. 


11. (a) a,c,d,c a,c,d,b a,c,e,f a,b,b,b 
a,b,b,f a,b,f,d. 

(b) In addition to those in part (a), b, b, b, b 
b,b,b,f b,b.f.d b,f,d,b bf, d,c 
c,d,c,d c,d,c,e c,d,b,b c,d,b,f 
c,e,f,d ef,d,b e,f,d,c  f,d,c,d 
f.d,cje f,d,b,b f,d,b,f. 


011111 
Oy ans Th) A 
Tae Oe ae ee 

B@)o 4 14 4 4 1f 
pe a 4.4 A 
Oh he 


{b) {(2,¢), (a, d), (a, 5), (a, €), (a,f), (B, 6), 
(b, ¢), (b, d), (b, €), (B. f). (sb), (C.€)s 
(c, d), (c, €), (¢, f), (4, b), (d, ©), (d, d), 
(d, e), (d, f), (@, b), (e, ©), (€, 4), (@, €), 
(ef), (f.), (fo). (6.2), f2), AAI- 


17. x; R” x; if and only if x, = x; or x, R” x; for some 
n. The i, jth entry of Mg. is 1 if and only if i = j 
or the i, jth entry of Mgz is 1 for some n. Since 


2) 
R° = U R& the i, jth entry of Mg. is 1 if and 
k=1 


only if i = j or the i, jth entry of Mg~ is 1. 
Hence My. = I, V Mge. 


19. 1,7,5,6,7,4,3. 
Exercise Set 4.4, page 129 


1. Reflexive, symmetric, transitive. 


3. None. 


5. Irreflexive, symmetric, asymmetric, antisymmet- 
ric, transitive. 


7. Transitive. 
9, Antisymmetric, transitive. 
11, Irreflexive, symmetric. 
13. Reflexive. 
15. Reflexive, antisymmetric, transitive. 
17, Irreflexive, symmetric. 


19. Symmetric. 


S) 
= 


Reflexive, symmetric, transitive. 


25 


(1, 5), (S, 1), (1, 6), (6, 1), , 6), (6, 5), (1,2), 
(2,1), 2,7), (7,2); 2,3), G,2)}- 


27. Let R be transitive and irreflexive. Suppose 
aRband bRa.Thena Ra since R is transi- 
tive. But this contradicts the fact that R is 
irreflexive. Hence R is asymmetric. 


29. (Outline) Basis step:n = 1 P(1): If R is sym- 
metric, then R! is symmetric is true. 

Induction step: Use P(k): If R is symmetric, 
then R* is symmetric to show P(k + 1). 
Suppose that a R«*! b, Then there isac GA 
such that a R* c and c R b. We have b Rc and 


c R* a, Hence b R**! a, 


? 


Exercise Set 4.5, page 135 
1. Yes. 


3. Yes. 


11. 


13. 


15. 


17. 


19. 
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Yes. 


{(a, a), (a, c), (a, e), (c, a), (c, c), (c, e), (e, a), 
(2,¢), , €), (b, 5), (8,f), (6. 4), (d, b), (d, d), 
GA) A 5), 64); FAY 


(a) (a, b) R (a, b) because ab = ba. Hence R is 
reflexive. If (a,b) R (a’, b’), then ab’ = ba’. 
Then a’b = b’a and (a’, b’) R (a, b). Hence 
R is symmetric. Now suppose that 
(a, b) R (a’, b’) and (a’, b’) R (a’”, b”). Then 


ab! = ba’ and a’b” = b’a’. ab” = ams = 
a ee P 
abe = ba ies ba”. Hence (a, b) R (a’, b”) 


and R is transitive. 
(b) {{C, 1), (2, 2), (3, 3), (4, 4), GS, SD}. (C1, 2), 
(2, 4)}, (1, 39}, (1, 4} (1, 5D), (2. 1), (4, 2)}, 
(2, 3)}, (2, 5}, (G, DI (GB, 20}, 16, 9), 
{GB 5)} (4, DI} (4, 3D}, (4, SD} IG, DI, 
(65, 2)}, (5, 3, (6, OW. 


Let R be reflexive and circular. If a R b, then 
aRbandbR b,so b Ra. Hence R is symmet- 
ric. If a R b and b Rc, then c Ra. But R is sym- 
metric, so a R c, and R is transitive. 

Let R be an equivalence relation. Then R is 
reflexive. Ifa R b and b Rc, thena R c (transi- 
tivity) and c R a (symmetry), so R is also circular. 


aR bif and only if ab > 0. 


Exercise Set 4.6, page 145 


1, 


3. 


VERT[I]=9 (1,6) NEXT[9] = 10 (1,3) 
NEXT{10] =1 (1,2) NEXT[i] = 0 
VERT[2]=3 (2,1) NEXTB]=2 (2,3) 
NEXT[2] = 0 

VERT[3]=6 (3,4) NEXT[6]=4 (3,5) 
NEXT/4] =7 (3,6) NEXT[7] =0 
VERT[4] = 0 

VERT[5] =5 (5,4) NEXT[5] =0 
VERT[6]=8 (6,1) NEXT[8] =0. 


On average, EDGE must look at the average 
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number of edges from any vertex. If R has P 


edges and N vertices, then EDGE examines 


>A; 
N 


or Or 


_m Ooo 


9. VERT TAIL HEAD NEXT 


P 
= —ed on average. 
N ges verag 


rP oor 


OoOrR Fr 


CDoOorRFR 


- OF Re 


oOrro 


VERT TAIL HEAD NEXT 


1 


4 
6 
8 


RW Ww NY NY &—& FF eR 


1 | 1 | 
3 1 4 
5 2 2 
6 2 3 
9 3 4 
4 1 
4 3 
4 5 
5 2 
5 5 


1 


2 
3 
3 
4 
1 
4 
2 


oOo nN Oo UN Oo WY NY 


Exercise Set 4.7, page 154 


1 


we 


wn 


11. 


(a) (C1, 3), 2,1), 2,2), 3,2), 3, 3)}- 
(6) (0,1), (2), @, 1), 2,3), B,D), G,2), GB, 3)}- 
© (G,D}. — G@) {,2), C1, 3), (2,3), G, 3)}. 


» (a) (2,1), B, a (3, 2), (3,3), 4,2), (4,3), 


(4,4),(1,4 

(b) {(1, 1), CL, 2), 2,2), (2, 3), 2,4), (4, DI}. 

(c) (1,1), 0,2), C1, 3), (1, 4), @, 2), 2, 3), 2,4), 
(3, 1), (3,2), (3,4), (4, 1), (4,3), (4,4)}. 

(4) {(1, 1), @, 1), @ 2), (1,4), 4 D, @, 3), 3,2), 
(1,3), (4,2), (3,4), (4, 4)}. 


» (a) {CL 1), (1,4), 2,2), (2,3), 3,3), GB, 4)]. 


(b) {(1, 2), (2,4), G, 1), G, 2)}. 

(c) (C1, 1), (1,2), CL 3), (1 4), 2, 1), 2,4),3, 1), 
(3,2), 3, 3)}- 

(d) (CL, 1), (2,1), G, 1), (4,2), (1, 3), 2, 3), G, 3))}- 


(b) 


= eee 
pe ee 
PPP Pe 


ran 
a 
Oo 
— 

a 
word 
ooor 
OorRPROA 


Ce OO oe 


| 
| » 


(d) 


oro°e oo oo 
eoor 

PoOoORrRO qoooo 
BPOorRrF OR OF 
POR OG PRP OR 
Oro rF 2p Oe 
PPP RP Pooc]e 


RNS = {C,1), 22), (2,3), 3,2), G3), (4.9), 
(5,5)} (1), (2,3), {4}, (S}}- 


. a) {}.  (b) RX R-A. 


(c) {a y) ly =x). 


. a(R 1 S)b if and only if a is an older brother 


of b. 


17. a(R U S)b if and only if a is a parent of b. 


19. (a) Yes. — (b)_ Yes. 
(c) x(S o R)y if and only if x = 6y. 


21. (a) Reflexive,a Ra/\aSa— aS Ra; 
Irreflexive,no1R2A2S51-—1(So R)1. 
Symmetric, no 1 R3,3R1,382,283 3 
1(S ¢ R)2, but 2 S-R 1. 

Asymmetric, no R = {(1,2), 3,4}, § = 
{(2, 3), (4, 1)} provide a counterexample. 
Antisymmetric, no R = {(a, b), (c, d)}, S = 
{(b, c), (d, a)} provide a counterexample. 
Transitive, no R = {(a, d), (6, e)}, S = {(d, b), 
(e,c)} provide a counterexample. 

(b) No, symmetric and transitive properties are 
not preserved. 


23. (a) 


PrP rR OR 
pee Pe ee 
or Fe SS 
SPP p 


(b) 


Or RP RP rR 
ororo 
eee Se 
PRP PP RP 


(c) 


oooococo OFF OSD ococ eo 


FPRPoOrRPR 
Pee Pe 
Orn or 
PPP PP 


(d) 


or RF RS Re 
Pe rR Of 
oOror rf 
RPP RPP 
FPP RF RP 


25. (a) Let (x, y) € (S U T)°o R. Then x R z, 
z(S U T)y for some z € B. Either z S y 
or z Ty and x8 o Ry or xT o Ry. Hence 
(x,y) ESoRU ToR. Now let (x, y) € 
SoRU ToR. Say (x,y) € To R.Thenx R z, 
z Ty for some z € B. Thus z(S U T)y and 
(x.y) E (SU T)OR. 
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(b) Let R = {(x, z), (x, m)}, S = {(z, y)}, and 
T = {(m, y)}. Then (x, y) € (So R)N (TeR), 
but (SN T)°R = {}. 


27. (a) Let Mans = [mj], Mg = [7], Ms = [5,,]. 
m,, = Lif and only if(j) EE RNS. 
Gj) © R if and only if 7,, = 1 and Gj) ES 
if and only if s,; = 1. But this happens if 
and only if i, jth entry of Mp /\ Mg is 1. 

(b) Let Maus = [77], Mp = [rij], Ms = [5;,]- 
m,, = 1 if and only if ij) ER US. 

(i,j) € R if and only if 7;, = 1 or Gj) € Sif 
and only if s,;, = 1. But this happens if and 
only if i, jth entry of Mz V Mg is 1. 

(c) The i, jth entry of M,-: is 1 if and only if 
Gj) € R” if and only if (j,) € R if and 
only if j, ith entry of Mg is 1 if and only if 
the i, jth entry of M% is 1. 

(d) The proof is similar to that of part (c). 


29. (a) x € Dom(R™!) if and only if x R7'y if and 
only if y R x if and only if x € Ran(R). 
y © Ran(R) if and only if x R y if and only 
if y R™'x if and only if y € Dom(R™). 

(b) x € Ran(R7?) if and only if y R7!x if and 

only if x Ry if and only if x € Dom(R). 
y © Dom(R) if and only if y R x if and only 
if x R71 if and only if y € Ran(R7). 


Exercise Set 4.8, page 164 


1 ie 
A(a){1 1 1]. 
111 


(b) (0, 1), 2), 3), (2,1), 2,2), (2,3), 
(3, 1), 3,2), 3, 3)}- 


0 


3. W, = 


oOroor 
roor fc 
ooo eo 
CoOrRRrRORFR 


5. Let R be reflexive and transitive. Suppose that 
x R" y, Then x, aj, 43, ...,@,-4,¥ is a path of 
length n from x to y.x Ra, /\a,Ra,—7x Ra). 
Similarly, we have x R a, /\ a, R ay,44 
x Ra,,, and finally x Ra,_,/\a,_,Ry> 
x R y. Hence R" C R. If x R y, then since R is 
reflexive we can build a path of length n, 
X,X,x,...,%,y from x toy and x R" y. 
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oOroce 
rer OF eS 


tt) 
1 
0 
0 


oor Fr 


POOF 
oOrro 
Poor 


0 
1 
1 
0 
11. A XA. 
13. AX A. 


15. A X A. 


Chapter 5 
Exercise Set 5.1, page 175 
1, (a) Yes, Ran(R) = {1,2}. (b) No. 


={( 
(c) Yes, Ran(R) = {1,2, 3}. 
(d) Yes, Ran(R) = {1}. 


w 


integer. 


5. Each r € R is either an integer or it is not. 


7. (a) 3. (b) 1. (c) @- 1). 
(d) xP -1. (e) y-2. (f) y*. 

9. (a) Both. (b) Neither. (c) One to one. 
(d) Onto. (e) Both. 


IL. (a) (go f)(a) = ft a> ‘ 2 (2) Sens: 


(b) (g° f)(@) = e(@ — 1) = Va +1-1= 
|a| = a, since a = 0. —_ 
(c) (go f)(X) = g(X) = (X) = 


of the complement). 


(d) (g of) (1) = a(4) = 1; (ee f) (2) = a1) = 2; 
(g ° f)(3) = a(2) = 33 (go f) (4) = 83) = 4. 


13. No, (a, 1), (a,2) Ef". 


. Each integer has a unique square that is also an 


X (properties 


15. 


17. 


1 


21. 


23. 


eo 


25. 


2 


(g° fa) ==4 @ N= 
Fb) = 2S 5 OQ) = 36 (gO = 


f-'3c) = 3e-1 


ni, 


Suppose that (go f)(a) = (g 0 f)(b). Then 
8(f(a)) = g(F()) and f(a) = f(b) because g is 
one to one. But then a = 5, since f is also one to 
one. 


Let g ¢ f be one to one. Suppose that f(a) = 
f(b). Then (g ° f)(@) = (g 2 f)(b) and a = b. 


Hence f is one to one. 


Suppose that O(a,,f) M O(a), f) # {}.Then 
F"(a,) = f!(a)) for some k, and k, 

(fF  fH)(a,) = a, = fY-*(a,), Hence 

a, © O(a,,f) and f"(a,) © O(a, f) for all n. 
Similarly, f"(a,) © O(a, f) for all 2. Thus 
0(@,,f) = O@, f). 


Since f is everywhere defined, Dom(f) = 
Suppose that f is one to one. Then, by Exercise 
24,|Ran(f)| = |Dom(f)| = n. Since | B| = 7, 
Ran(f) = B and f is onto. Next, suppose that f 
is onto. Then Ran(f) = B,|Ran(f)| = n, and 
|Dom(f)| = n. By Exercise 24, f must be one to 
one. Since (a) and (b) are equivalent, (a) and 
(b) are each equivalent to (c). 


Exercise Set 5.2, page 180 
L(a7  (b) 8 (e) 3. 


3 (a1 (b)0 @L 

5. (a) 2. (b) -3. () 14. (a) -18. 
(e) 21. 

7. (a) 26.  (b) 866. (c) 74. (d) 431. 

9 (a) 2. (b) & ~~ (c) 32. (d):1024. 


1. (a) 4. (b) 7. (©) 9. (dd) 10. 


13. For any 5 x 5 matrix M, M’ exists, so f is every- 
where defined. If M is a5 X 5 matrix, then 
t(M’) = M, so ris onto. Suppose that M? = N?. 
Then (M’)? = (N’)’; that is, M = N and t is one 
to one. 


15. Every relation R on A defines a unique matrix 
Mg, so fis everywhere defined and one to one. 
Any 7” X n Boolean matrix M defines a relation 
on A, so f is onto. 


17. (a) True. (b) False. (c) False. 
(d) True. 
19. (a) 31. (b) 0. (c) 36. 


Exercise Set 5.3, page 188 
1. (a) Yes. (b) No. (c) Yes. (d) No. 


123 4 5 6 
3) ( 4 12 6 a 
123 4 5 6 
(®) : 5 6 3 1 A) 
@{t 2345 6 
52) 3G cay 
L Bae Sy ce 
@) ( Ss 2.6 | 


5. (a) (1,5,7,8,3.2).  (b) (2,7,8,3,4,6). 


7. (a) (a.fig)(b,c,d.e). — (b) (a,c) o(b.8.f). 


»2,5,4,8). 
) 0 (1,2, 3). 


IL. (a) (2,6) © (2,8) © (2,5) © (2, 4) o (2,1). 
(b) (3, 6) © (3, 1) © (4, 5) © (4,2) © (4, 8). 


13. (a) Even. (b) Odd. 


15. (a) (3,2) © (3,5) ° (3,1) © 3,4). 
(b) (1,3) © (1,5) e (1,2) ° (1,4). 
17. (a) (1,2, 4). () {3 : ; : ) 
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6 
gh 3 


19. (a) (Outline) Basis step:n = 1 If p isa per- 
mutation of a finite set A, then p! is a per- 
mutation of A is true. 

Induction step: The proof in Exercise 16 
shows that, if p"~1 is a permutation of A, 
then p”~1o pis a permutation of A. Hence 
p” is a permutation of A. 

(b) If |A| = n, then there are n! permutations 
of A. Hence the sequence 1,, p,p’, p’,... is 
finite and p' = p/ for some i ¥ j. Suppose 
that i<j;then p™'op' = 1, = p™‘op/.So 
pii=1,j-i€Z. 


Exercise Set 5.4, page 194 


1. (a) The number of steps remains 1001. 
(b) The number of steps doubles. 
(c) The number of steps quadruples. 
(d) The number of steps increases eightfold. 
(e) The number of steps increases by 1. 
(f) The number of steps is squared. 


all =(n(n — 1)(n—- 2)°:- 2-1/5 
1:|nen--n|n2l. 


3. 


5. 


8n + ig(n)|<|8n + n|=9|n|n=1. 


7. 


n Ig(n)| s ln : ni = n’,n = 1. Suppose that 
there exist c and & such that n? <c- n Ig(n), 

n =k. Choose N > k with N > c - ig(N). Then 
N? <c-+ N-Ig(N) < N’,a contradiction. 


9. 


Sn? + 4n + 3| = |5n? + 500n|,n = 1; 
[Sn + 500n| <= 5[n? + 100n|. We have |n? + 
100n| = |n? + 4- 25n| = |n? + 4n?|,n = 25. 
But |5n?| =< |5n? + 4n + 3). 


IL. (65), (fo fio» fil: Ul (fal, (fs) CA Ul. (ab Ul, 


fi. 
13. f(n)=2+18-6+1orlll, O(1). 
15, f(n) =2+n-5+1orf(n)=3 + 5n, O(n). 


17. f(n) =2 +4n-2, O(n). 
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19. Suppose that a <b. Thenn’ sn?.n = 1. 
Suppose that n° <= c+ n*, for n = k. Choose 
N > k with N°~*>c.Then NP <c-N*< 
N°-4- N* = N° a contradiction. 
Suppose that 6(n*) is lower than @(n”), Then 
n'sc-n’,n= k. Suppose that a > b. Choose 
N>kwith N*-’>c.ThenN?sc-N?< 


N?-*. N® = N“ a contradiction. Hence a < b. 


Chapter 6 


Exercise Set 6.1, page 203 


L V = {A,B,C,D}, E = {{A, B}, (B, C}, (B, Dy}. 
There are two edges between A and B. 


3. V = [A, B,C, D}, E = {{A, B}, [B, C}, (D, A}, 
{D, C}}. All edges are double edges. 


5. A 
ei ( €2 
D 
e4 e3 & 
B E 


7. Degree of A is 2; degree of B is 3; degree of C 
is 3; degree of D is 1. 


9. A,C; A,C, B; A,C,D; A, C,E. 


13. Only the graph given in Exercise 3 is regular. 


19. n — 1. The two end points have degree 1; the 
other n — 2 vertices each have degree 2. Hence 
H+ es 
the number of edges is A) Aan} or 
n — 1,since each edge is counted twice in the 
sum of the degrees. 


Exercise Set 6.2, page 210 


1. (a) Neither. There are four vertices of odd 
degree. 

(b) Neither. There are four vertices of odd 
degree. 


3. (a) Euler path only, since exactly two vertices 
have odd degree. 

(b) Euler path only, since exactly two vertices 
have odd degree. 


§, Yes, all vertices have even degree. 


is one possible 
answer. 


9. Yes. Note that if a circuit is required that it is 
not possible. 


is one possible solution. 


13. 9. 


49 
i \e4 I 
Cad 


is one possible solution. 


7 
24 18 


15. See the solution for Exercise 13. The consecu- 


tively numbered edges are one possible circuit. 


Exercise Set 6.3, page 216 
1. Neither. 


3. Neither. 


§, Hamiltonian circuit. 


7. A,B, D,F,G,H,E,C,A. 
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9. A,B,C, E,D,F,J,G,H,1, A. 
1. C,A, B, D,F,G,H,E,C. 


13. 1,H,G,J,F, D, E, C, B, A, 1. 


Exercise Set 6.4, page 222 


1 A 

Cc B 
D 
E 
3. ME 
NH MA 
RI 

VT CT 


5. (a) 2. (b) 3. 

7. Pox) = x(@ — 17x — 2), x(G) = 3. 

9. Po(x) = x(x — 1%(x - 2), x(G) = 3. 
1. Py (x) = x(x — 1x - 27, x(G) = 3. 
13. P(x) = 2x — 1, x(G) = 2s yes. 


15. (Outline) Basis step:n = 1 P(1): F(x) = xis 
true, because L, consists of a single vertex. 
Induction step: We use P(k) to show P(k + 1). 
Let G = L,,, and e be an edge {u, v} with 
deg(v) = 1. Then G, has two components, L, 
and v. Using Theorem 1 and P(k), we have 
Pe (x) = x + x(x — 1-1. Merging v with u 
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gives G° = L,. Thus P(x) = x(x — 1)*71. By 
Theorem 2, P,, (x) = x°(x — 1)"! — 

x(x — 1981 (ae — 1)= x(x - 1h "(a - 1) or 
x(x — 1). 


Chapter 7 


Exercise Set 7.1, page 236 


1. (a) No. (b) No. (c) Yes. (d) Yes. 


3. {(a,4), (b, b), (c,c), (@, bY}, ((a, a), (BB), (e.¢), 
(a, b), (a, c)}, ((4, 2), (6, b), (c, ©), (a, 6), (c, bY, 
((@, a). (b, b), (¢, c), (a,b), (6, ¢), (a, ¢)}, 

{(a, a), (b, b), (¢,¢), (a,b), (c, b), (c, @)}. 


7. (a) {(1,1), (2, 2), (3, 3), (4, 4), (1, 3), 4, 4), (2, 3), 


(2, 4), (3, 4}. 


(b) (G1), 2,2), G, 3), 4, 4), (1,2), (1, 3), CL, 4), 


(2, 3), (2, 4), (3, 4)}. 


% 4 
3 
2 5 
1 
11111 
0 100 0 
1. (a)|0 0 1 0 Of. 
00010 
00001 
111411 
01010 
(by) }/0 0 1 0 14. 
00010 
00001 


13. (a) 30 (b) 32 @ Linear. 
10 15 16 
2 3 § 
4 
1 
2 


15. ACE, BASE, CAP, CAPE, MACE, MAP, MOP, 


17. 


MOPE. 


a 


19, For every a,b € A, either a R b or b Ra. Hence 


21 


23. 


either b R''aoraR" b,and R'is a linear 
order. 


Suppose thatx< y, y<z, x,y,z @A.Then 
x < z,so < is transitive. Clearly, x # x,x € A; 
< is itreflexive. Thus < is a quasiorder. 


(a, b) < (a, b) since a | a and b S b. Thus < is 
reflexive. Suppose that (a, b) < (c, d) and 

(c, d) < (a, b). Then a|c and c| a. This means 
that c = ka = k(ma) and, for a and c in B, 

km = 1 implies that k = m = 1. Hence a = c. 
Also, b <= d and d <= b, so b = d. Thus < is anti- 
symmetric. Suppose that (a, b) < (c, d) and 
(c, d) < (e, f). Then a|c and c| e. Hence 

c = ka, e = mc, and we have e = m(ka) and 
ale.b<d,d =f yields b sf. Hence (a, b) < 
(e, f) and < is transitive. 


25. 3 3 Define G as follows: 
GQ) =0, G()=1 
4 2 G(4) = 2 G(8) = 3 
The Hasse diagrams confirm 
2 1® that if a = b, then G(a) =’ G(b). 
1 0 


Exercise Set 7.2, page 244 


1. (a) Maximal 3, 5; minimal 1, 6. 
(b) Maximal f, g; minimal a, b,c. 


3. (a) Maximal none; minimal none. 
(b) Maximal none; minimal 0. 


5. (a) Greatest f; least a. 
(b) Greatest e; least none. 


7. (a) Greatest none; least none. 
(b) Greatest 1; least 0. 


9. (a) fig. h. (b) a,b,c. (c) f-. (d) c. 
11. (a) d,e,f. (b) b,a. (c) d. (d) b. 
13. (a) None. (b) 5. 


15. (a) x € (2,2). 
(d) 1. 


(b)xE(—*, 1}. (©) 2. 


17. (a) {a,b}, {a,b,c}. 
(c) {a, 5}. 


(b) {}, {a}, {5}, fa. 6}. 
(d) {a,b}. 


19. h 


(c) None. (d) b. 
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Exercise Set 7.3, page 256 


1. 


3. 


5. 


11. 


13. 


15. 


17. 


19, 


(a) Yes. (b) No. 


(a) Yes. (b) No. 


(1, be) 
(at, bp) oe (bi, a) 


(a), a9) 


. Let x, y be in [a,b]. Thenx <x V y <b, so 


xVyE€fa,b.asxAysxsb,soxAye 
[a, b]. Hence [a, b] is a sublattice. 


. (1,2, 3, 6, 12}, (1,2, 3, 6, 12, 24}, (1, 2, 6, 12, 24}, 


(1, 3, 6, 12, 24} 


Let L be a bounded lattice, | L| = 2. Suppose 
that 0 = I. There must be x # 0,x # I. Then 
xV0=xandxV0=xVI=L But thisisa 
contradiction; x # [. Hence 0 # J. 


Let a,b,cbein Z*.aN\(bVc) = 

min(a, b V c) = min(a, max(b, c)) = 
max(min(a, b), min(a,c)) = (ab) V (ac). 
a\V/ (b/\c) = max(a,b Ac) = 

max(a, min(b, c)) = min(max(a, b), 

max(a,c)) = (a Vb) A (aV oc). 


Let a, b,c be elements of a linearly ordered 
poset. Suppose that a = b = c. Then 

aN (bVc) =aNc=a.Also,(aN\b) Vv 
(a/\c) = a\V a= a. Similar results hold for the 
other five possible orderings of a, b, and c. 


(4, a) A (by, by) V (cy, &)) = (4) A 

(BV cy, By V &)) = (a A (8 Vy), a A 

(5, Vv ©)) = ((a A b,) Vv (a, A c), (a, A b,) Vv 
(a, A c5)) = ((a, 2) A (64, By) V (Cay, a2) A 
(cy, C)). A similar argument establishes the 
other distributive property. 


Suppose that a = (b/c). Thena V (b Ac) = 
bAc.aS (6 Ac) implies that a Sb anda Sc. 
Thus (a V b) A (a V c) = b Ac. Hence 
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21. 


23. 


27. 


8 


. (a) Neither. 
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aV (bAc)=(aV b)AN(aVo). 

For the other distributive property,a A (b V c) = 
a,sincea = bandasc.(aNb)\V (ac) = 
aVa=a.HenceaN(bV c) = (aAb)V (ac). 


Suppose thata \x =a/AyandaVx=aVy. 
Then y= y V (yAa)= (¥Ay) VQ Aa)= 
yNVVa=qyA@Vn=VAQV VAX = 
(aAxViyAx)=xA(aVy) Sx. 

Hence y = x.A similar argument shows that 

x = y. Thus x = y. 


V=42, 42’=1, 2’=21, 21’=2, 3°=14, 
14 =3, 7 =6, 6 =7. 


(b) Neither. 


Ifx =x,thenx =xVx=Jandx=xAx=0. 
But, by Exercise 11,0 # I. Hence x # x’. 


Suppose that ?, = %,.Then R, C R,. Letx € 
Aj then A; = [y] xR, y} and A; C [y] x R, y} = 
B,, where x € B,. Suppose that each A, C B,, 
then x R, y implies that x R, y and R, C R). 
Thus P, = P,. 


Exercise Set 7.4, page 265 


1, 


3. 


5. 


7. 


9. 


11. 


13. 


No, it has 6 elements, not 2” elements. 

No, it has 6 elements, not 2” elements. 

Yes, it is By. 

Yes, it is By. 

Yes, 385 =5-7-11. 

No, each Boolean algebra must have 2” elements. 


Suppose that a = b. (a \ b’) V (a’ Ab) = 
(BABY V (a Aa) =0V0=0. 

Suppose that (a A b’) V (a’ A b) = 0. Then 
a/\ b' = @and a’ \b = 0. We have I = 0’ = 
(aA by =a’ \ b.So a’ is the complement of b; 
=a’. 


15. 


17. 


(a) Suppose that a V b = b.ThenasaV b= 
b. Hence a/\ b =a. 

(b) Suppose that a \ b = a.Then a’ = (a/ by 
=aVb' Sod Vb=(aVb)Vb= 
a V(b’ Vb) =a’ VI= a’. 

(c) Suppose that a’ V b = I. Then @ = I’ = 
(a V bY =aNb’. 

(d) Suppose that a A 5’ = 0.Then a = 
aNI=aN(bVb)=(aAb)V@Ab)= 
(ab) V0O=aAbsb. 

(e) Suppose that a < b. Thena V b = b. 


bA(aV (@ A(bV by) =bA@V (a AD) = 
bA(aV a’) =bAI=b. 


9. (aVvaAN(P VOY =(aAb)Vcy = 


G@AbyY Nc =(@Vb)Ac. 


Exercise Set 7.5, page 270 


1. 


x y Zz xA(WV2z’) 
0 0 0 0 
0 0 1 0 
0 1 0 0 
0 1 1 0 
1 0 0 1 
1 0 1 0 
1 1 0 k 
1 1 1 1 
tT 
ry 2 [aVyY)VOAW Vy) 
0 0 0 0 0 0 1 
0 0 1 0 0 0 1 
0 1 0 0 1 1 1 
0 1 1 0 1 1 1 
1 0 0 1 1 0 0 
1 0 1 1 1 0 0 
1 1 0 0 1 1 1 
1 1 1 0 4, 1 1 
a) @ 8) @ 


» AVYAR Vy =AAX)Vy=O0Vy=y. 


LV xXAN(KAYVAAYVy)= 


( V@Ay)AGAY) V2) = 
Ay Ve Azl=aAy)VO=xAy. 


Answers to Odd-Numbered Exercises 499 


13. (Z@AX)VWAxAyVWAKAY). 
15. XW’ Ay) V Ay). 
Wn WAYVYAZVaAYA?Z). 


19 (ZAXAW)V AXA) V (2 AxAw). 


(b) 


«Vy AV 2) 


Chapter 8 
Exercise Set 8.1, page 291 


1. Yes, the root is b. 
3. Yes, the root is f. 
§. No. 


1 yy 
«| 9 | 
| o |G] 7. Yes, the root is t. 


x 


9. (8) Viz, Vio Van Vise Via: 
(D) Vio» Vat ¥5s Vi25 Va» Vise Vias Vo» 


11. (a) (nr) 


(b) 


13. (T, vg) may be an n-tree for n = 3. It is not a 
complete 3-tree. 


15. Each vertex except the root has in-degree 1. 
x’ Ay)V Ay). Thus s = r—1. 


9. 2° V (x Az). 17. (a) 4. The tree of maximum height has one ver- 
tex on each level. 


IL. (2’ Ay) V (Ay) V OA 2). (b) 2. 


500 = Answers to Odd-Numbeted Exercises 


19. The maximum number of vertices on level k is 
2*. Hence the maximum number of vertices is 
1424242 4-+-- +42", or 24), 


Exercise Set 8.2, page 298 


LINK 
_ SOA DY 


13, 721. 15. A 


o;o];}o;]xynt]o 


LEFT DATA RIGHT 
: 
3 sa 
5 = 
9 = 
7 + 
11 x 
t— 
0 2 
+— 
0 x 
el 
0 x 
0 2 
pote) 
0 2 
x 


Exercise Set 8.3, page 308 


1. 


we 


e 


| 


\-) 


. 


11. 


13. 


17. 


xXysZtuy. 
abcghidkejf. 
ysxZvut. 
gchbiakdjef. 
Syvutzx. 
ghcibkjfeda. 


I NEVER SAW A PURPLE COW I HOPE I 
NEVER SEE ONE. 


x6 
21° 


AI 00 
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19. BT?) a 


Exercise Set 8.4, page 319 
1. e f 


d a 


5. e 
c b 
d 
a 
7. a 
6 f 
¢ e 
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% ag b 
| : 
11. a b c 
| = 
e 
13. b e 
a d f 
c & 
b G 
OKO 
c 8 
b e 
<Y > 
e g 
15. ; 


> 
x 
a ie) 
a e 
to 
a n 


There are 5 spanning trees. 


17. (a) Five. (b) n. 


Exercise Set 8.5, page 326 


1. B D H 


11 Suppose that e, is the required edge. Let 
S = [e,,e,,...,&} — {e,} and E = {e,}. 
Step 1. Choose an edge e, in S of least weight. 
Replace E with E U (e} and S with S — {e}. 
Steps 2 and 3 are as before. 
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13. Change step 1 to read “Choose an edge e, in S a b a b 
t he ad 

of greatest weight z ab = qa 

b aoa b boa 


15. Define v to be a farthest vertex of V = 
{v),¥),...,¥) if v is adjacent to some v, in V (3) (4) 
and no other vertex is joined to a member of V 


by an edge of greater weight than (v, v,). In step ab a b 
2 replace “nearest” with “farthest.” 
a aoa a b b 
b ab b aia 
17. If each edge has a distinct weight, there will be 
a unique minimal spanning tree since only one 6) (6) 
choice can be made at each step. 
a b a b 
Chapter 9 a b a a b a 
b bo a b a b 
Exercise Set 9.1, page 333 (7) (8) 
1. Yes. 
a b a b 
3. No. a a b a a b 
b boa b a b 
5. No, (9) (10) 
7. No. 


9. Commutative, associative. a 


o 
eals 
eal > 

= ea 

No 

AS) 
eos 
aol oe 


11. Not commutative, associative. 


2 
eo 


13. Commutative, associative. 


ro 
ee 


15. Commutative, associative. 


17. Commutative, associative. 


19. (a) a,a. (b) ¢, B. (c) c,a. 
(d) Neither. 


FS Ges Gites ay 
ier) = w — 
wy 2 =, 
oan a aocla 
cor] st colo 
anne Fea 
2 = 
rorpT | 
rol oe 


23. (a) an OB ab 25, A binary operation on a set S must be defined 
for every a, b in S. According to the earlier defi- 
a aoa a boa nition, a * b may be undefined for some a, 5 in 
b ee b a 2g S. Any binary operation on a set S is a binary 


QQ) (2) operation in the sense of Section 1.6. 
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Exercise Set 9.2, page 340 


1. Semigroup: (b), (c), (d), (e); monoid: (b), (c), (d). 


3. Monoid; identity is 1; commutative. 
5, Semigroup. 

7. Monoid; identity is $; commutative. 
9. Monoid; identity is 12; commutative. 
11. Monoid; identity is 0; commutative. 


13. Neither. 


15. Let f,(a) = a, f(b) = a; f,(@) = a, f(b) = 6; 
Fila) = 5, f(b) = a; f,(a) = b,f,{b) = b. These 
are the only functions on S. 


2 1 2 3 4 
Alf wf hi ot 
4 1 fi 4 1 4 


17. (a) abaccbababc (b) babcabacabac 
(c) babecbaabac 


19. By Exercise 18, we need only check that 
e€ S$, S,. But e € S, ande € S,, because 
each is a submonoid of (S, *). 


21. Yes. Refer to Exercise 1. 


23. Let x,y € Sy. (go f(x *, y) = g(f(x #1, y)) = 
8(F(X) #2 FO) = BF@)) #3 B(FO) = 
(g ° f)(x) *; (g ° f)(y). Hence ge fisa 
homomorphism from (S,, *;) to (53, *5). 


25. Let x, y © R*.In(@ * y) = In(z) + In(y), so In is 
a homomorphism. Suppose that x © R. Then 
e* € R* and In(e*) = x,so In is onto R*. Sup- 
pose that In(x) = In(y); then e!"® = e!"©) and 
x = y. Hence In is one to one and an isomor- 
phism of (R*, <) and (R, +). 


Exercise Set 9.3, page 347 


1. Let (81, 1), (82) ES X T. (51,0) *” (a, ) = 
(8, * Sz, t, *’ t,), So *” is a binary operation. 
Consider (5,, 4) #” ((8, th) *” (53,5) = 
(51, 0,) #” (82 # 53, ty #5) = (1 * (52 * 55), # 

(ty ¥” ty) = (51 * 52) #53, (4 *” ) # ) = 

(45 t1) *” (8p, to) *” (55, 3). Thus (S X T, *”) isa 
semigroup. (5,,t,) *” (5), ) = (8, * 5, t, *’ h) = 
(52 * 54,0, *” t)) = (5, t) *” (5;, 4). Hence *” is 
commutative. 


3. Let (51, t;), (8, 4) & S X T. Then f(s, t,) *” 
(S25 &)) = FCS, * Sy fy #” ) = 5, * 52 = 
f(81,t)) * f (8, 6). f is a homomorphism. 


13. Yes. 


15. Let R, and R, be congruence relations on S$. By 
Exercise 18, Section 4.5, R, M R, is an equiva- 
lence relation on S. Suppose that s,(R; M R2)t, 
$(R, O Ry)ty. Then s; Ry ty, 52. Ry ty, $ Ry ty, 82 Ry ty 
and (s, * 52) R, (t, * t), (s, * 5.) Ry (t, # t). 
Hence (s, * s,)(R, 1 R,)(t, * ,). Thus R, ON R, is 
a congruence relation on S. 


17. (S/R, ©) is the collection of rational numbers in 


. @ cab, 
lowest terms with - © — = — in lowest terms. 
b-d cd 


19. (a) ® | [a] [9] 


[a] | [a] [>] 
[ob] | [4] [4] 


(b) fle) = La] = f(a), fel) = [b} = feo). 


Exercise Set 9.4, page 359 
1. No. 


3. Yes; Abelian;identity is 0; a~' is —a. 


5. No. 
7. No. 
9. No. 
11. Yes; Abelian; identity is { };a71 is a. 


13. Suppose that x? = x. Then x" '(x”) = x7 'y and 
x=e. 


15. (a) = (b) —. 


19, Consider the sequence e, a, a’, a°, .... Since Gis 
finite, not all terms of this sequence can be dis- 
tinct; that is, for some i = j,a' = a/. Then 
(a"')ai = (a ‘Ya! and e = a@/~'. Note that 
j-i2zo. 


21. No. 
23. Yes. 
25. Clearly,e € H. Let a,b © G. Consider (ab)y = 
a(by) = a(yb) = (ay)b = (ya)b = y(ab) Vy € G. 
Hence H is closed under multiplication and is a 
subgroup of G. 


27. The identity permutation is an even permuta- 
tion. If they are even permutations, then each 
of p, and p, can be written as the product of an 
even number of transpositions. Then p, ° p, can 
be written as the product of these representa- 
tions of p, and p>. But this gives p, o p, as the 
product of an even number of transpositions. 
Thus p, ° p, € A, and A,, is a subgroup of S,,. 


ALA fo fohh ifs fo feb Ul fot fi fh 
{fipfel rfl: fet th feb De 


- 31. 


Answers to Odd-Numbered Exercises 505 


y|. Thus f(xy) = f(x) f(y). 


xy| = |x 


33. Suppose that f: G -» G defined by f(a) = a’ is 
a homomorphism. Then f(ab) = f(a) f(b) or 
(ab)? = ab’. Hence a (abab)b™! = 
a" \(a’b*)b™ and ba = ab. Suppose that G is 
Abelian. By Exercise 18, f(ab) = f(a) f(b). 


35. By Theorem 1, Section 5.1, we have that f~ 
is also one to one and onto. Let x’, y’ € G’. 
Then there exist x, y in G with f(x) = x’, 
f(y) = y f(xy) = xy’ Hence f"(x'y’) = xy = 
f3(%) £0”). Thus f~ is an isomorphism from 
G’ toG. 


37. f(a + b) = 2(a + b) = 2a + 2b = f(a) + f(D), 
so fis a homomorphism. Suppose that a is an 
even integer; then n = 2k, k © Z,and f(k) = n. 
Thus fis onto. Suppose now that f(a) = f(b). 
Then 2a = 2b and a = b. So fis one to one. 
Hence f is an isomorphism. 


Let x,y € G. f(xy) = axya™! = axa”! aya! = 


f.A(x)f,(y). f, is a homomorphism. Suppose that 
x € G. Then f,(a"'xa) = aa”! xaa™ = x, 80 f,, is 
onto. Suppose that f,(x) = f,(y); then axa! = 
aya”, Now a (axa )a = a“ (aya™)a and x = 
y. Thus f, is one to one and an isomorphism. 


39. 


Exercise Set 9.5, page 365 


1 


@,1) ©,2) (0 


5/0 GD) G2 Gd) GD Gd 
(0,1) | (0,1) (0,2) (©,0) @,1) @,2) G,0) 
0,2)| 0,2 6,0) @©1) 4,2) 4,0) GD 
@,0)}G Gi) G2 @d @i) @2) 
GD/GD @D Gd BD @2 GZ 
GVIGD @d) GD) @ @d) @d 


3. Define f: G, > G,: (81, 82) > (82,81). BY 
Exercise 4, Section 9.3, fis an isomorphism. 


eo i 2) 
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7. 


13. 


17. 


21. 


23. 


(a) {[0]}, ([1J} (121), (13). 


(b) {0}, [2]}, (111. B3- (©) {f0], {1 (21, 3}. 


- (a) {L0], [4]}, (14), BU, (12). Lol}. (3); (7). 


(b) {[0], [2], [4], [6]}, (1), (8). D5), [7]}- 


- ((m + x,n + x) |x © Z} for (m,n) E Z X Z. 


If N is a normal subgroup of G, Exercise 12 
shows that a~'Na C N for all a € G. Suppose 
that a~'Na C N for all a & G. Again, the proof 
in Exercise 12 shows that N is a normal sub- 
group of G, 


* (fil: {fF}, {fifa foofels {foto fy ta {folyfrfel dD, 


Suppose that f,(A,) = f,(A,). Then ah, = ah, 
and a“ '(ah,) = a '(ah,). Hence h, = h, and f, is 
one to one. Let x € aH. Then x = ah,h € H, 
and f,(h) = x. Thus f, is onto, and since it is 
everywhere defined as well, f, is a one-to-one 
correspondence between H and aH. Hence 

|H| =|aH|, 


. Suppose that f(aH) = f(bH). Then Ha = 


Hb" anda! = hb™',h € H. Hence a = 

bh-! & bH,so aH C bH. Similarly, bH C aH, so 
aH = bH.This means that f is one to one. If He 
is a right coset of H, then f(c' H) = He, so fis 
also onto. 


Consider f(aba~'b~') = f(a) f(b) f(a) f(b") = 
f@FOYOFE =fOF@) FOE)" 
(by Theorem 5, Section 9.4) = ee = e. Hence 
{aba-'b-' | a, b in G,} C ker(f). 


Let a € H. The left cosets of H are H and aH. 
The right cosets are H and Ha. H 1 aH = 

HO Ha={}and HU aH = HU Ha.Thus aH = 
Ha. Since a € H + aH = H, we have xH = 

Hx Wx © G. H is a normal subgroup of G. 


. Suppose that f: G —> G’ is one to one. Let 


x € ker(f). Then f(x) = e’ = f(e). Thus x = e 
and ker(f) = {e}. Conversely, suppose that 
ker(f) = (e}. lf f(g,) = F(g,),then f(g,e;') = 
fle Fler) = fed Fed)" = fedfedy? = 
e. Hence g,g;! € ker(f). Thus g,g,! = e and 
&, = 8. Hence f is one to one. 


Chapter 10 
Exercise Set 10.1, page 377 
1. {x”y"z,m 2=0,n = 1}. 

3. {a"*",n =O}1U| (abn =O}. 


5. ((...(a@tatt+a)...),k20,n = 3}. 
i oe ~v 
k na’s k 


7. {x™yz",m =1,n= 0}. 


9 (a), (c), (€), (A), @. 


13. ¥9 
v1 
a 
b x” 
v1 
a 
a 
15. vo Vo 
Vo, Vov1 
VOY VoVoV1 
VaVo% xyvy 
xyz xyz 
17.1 I 
LW LW 
aw LDW 


alDW aDDD 
alDD aiDD 
al0D ali0D 
a100 a100 


19. G = (V,S, v9), V = {¥, v,, 0, 1}, S = {0, 1} 
2% Ov,1, v9 H 1v,0, v, H Ov,1, v, Fe 1¥,0, 
v, + 01, ¥, > 10. 


21. G = (V,S, vb), V = {¥9,v,, 4, b}, S = {a, b} 
2 V9 > aav,bb, v, + av,b, v, ab. 


23. G = (V,S, vo), V = (Vox, y}5 = fx, y} 
19 VQ Voyy, Vo 2 XVy, Vg > XX. 


25. (a), (d). 


Exercise Set 10.2, page 389 


1. (¥%) = x (%)/¥ (Y,) 
(vy) o=yly,)(z 


Vv 
: 


3. (vo) = a (v,) 
(4) #= bv) (a 


(2) 
5. (v9) = aa (v9) |b (v,) 


(v,)2=c(v,) bl cb 
(v2) 1: = bb (v2) | bb 
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Te (Vg) 2 = x (Vg) ly (vq) [|Z 


9 (vy) B= aly) 
(vy) == b (v9) {a 


IL. (vy) 1 = ab (v,) 
(vp) = e(y,)| (vy) 
(vy, ) = da(v,)|d 
13. (aa)*aa. 
15. (( )*(a + a + (a +)*a(_))* 
Note: Right and left parentheses must be 
matched. 
17. (aVbV chaVbVcVOVIV:::V9)* 
19. ab(d V (d(c V d)d))* 
Exercise Set 10.3, page 396 


lk 8 0 0 
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9. 


11. 


13, 


a b 
Sy Sy 5 
5, 3} 59 


Let x € f. Certainly, f(s) = f,(s) for alls € S. 
Thus x R x and R is reflexive. Suppose that 

x R y. Then f(s) = f,(s) Ws © S. But then y R x 
and R is symmetric. Suppose that x R y,y R z. 
Then f,(s) = f,(s) = f(s), Vs © S. Hence x R z 
and R is transitive. 


Using Exercise 10, we need only show R is 
reflexive and symmetric. Lets € S.s = ¢ * 5,80 
f(s) = sands Rs. Suppose that x R y. Then 
f(x) = y forsomez € Sy =zexzley= 
x and thus f,.(y) = x. Hence y R x and R is 
symmetric. 


(a) Inspection of Mz shows that R is reflexive 
and symmetric. Since My O Mg = Mg, R is 
transitive. Thus R is an equivalence rela- 
tion. The table in part (b) shows that it is a 
machine congruence. 

0 1 


(1) [1] 
[2] [2] 


(b) 


[2] 


Inspection of Mg shows that R is reflexive and 
symmetric. Since Mz © Mz = Mz, R is transi- 
tive. Thus R is an equivalence relation. The 
digraph shows that it is a machine congruence. 


Exercise Set 10.4, page 402 


1. 


3. 


f.S0) = 52 FulS1) = 53, fulS2) = So A,(83) = 54. 


The number of 1’s in w is divisible by 4. 


5. The number of 1’s in w is2 + 4k,k = 0. 

7. Fi(So) = Soo fulS1) = Sor fu(S2) = So 

9. All words ending in b. 
11. Strings of 0’s and 1’s with 3 + 5k 1’s,k = 0. 
13. Strings of 0’s and 1’s that end in 0. 
15. Strings of a’s and b’s that do not contain bb. 
17. Strings of 0’s and 1’s that end in 01. 


19. Strings xy and yz. 


Exercise Set 10.5, page 411 


1. G=(V,L,Vo,), V = (89, 81, 52,53, 0, 1}, 7 = (0, 1} 
19 25919 059, 59 9 151, 5, 9 05, 5, 15>, 
S_ > 055, S$) > 153, 5. > 159, 55 9 053, 5,1 0, 
5314 159 


3. (OV 1)*1. 


§. G=(V,L, %, 9), V = {59, 51, 52,0, 1}, 2 = {0, 1} 
(50) = asg)|b(s,)lalb 
(s,) v= a(sy)|b4s,) la 
(35) = a(s,)|b(s) 
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T = {s,}. 


T = {s)}. 


So Sy Sq 
sy 54 Sy 
54 53 Sy 
53 53 53 


. Ris reflexive because f,,(x) = f(x). R is sym- 
metric because if f,(s,), f,(s;) are both (not) in 
T, then f,,(s,), f,(s,) are both (not) in T. R is 
transitive because s; Rs, s; Rs, if and only if 
Ful5), FCS) Fo(S,) are all in (or not in) 7. 


Exercise Set 10.6, page 417 


L. Rg = {(59, 50), (So, 81)s (S12 5q)> (Sy, 51)s (82 52)}- 


3. R, = {(S0: 50); (S1, 54); (52, 52), (5, 53), (54,54); 
(Ss 53)s (83s 50)» (51,52), (Sa, 51)}- 


§. Rin = Ry. 

7. R, = R,. 

9 R= {(SorS0)s (81551): (S29 )}- 
11. R = R, as given in Exercise 6. 


13. P = {f5p, 51,54}, {Sa}, {5}, {55 Sel]. 
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15. R = {(5q, 50), (81551); (S25 52)s (S35 53), (Sa, 84)s (855585), 
(56, 56)s (S4y 85)5 (Ss, 84)s (S356)> (Sey 83)}- 

Chapter 11 

Exercise Set 11.1, page 431 

Las 2 @©3 @4 €)5. 
(f) 3. 

3. (a) Yes. (b) Yes. (c) Yes. (d) Yes. 

5. (a) 8(x,y) = |x ®y| = |y Ga| = Hy, x) since 


xOy=yOx. 

(b) 8(x, y) is the number of positions in which x 
and y differ, so 5(x, y) = 0. 

(c) If x = y, they differ in 0 positions and 
(x, y) = 0. Conversely, if 6(x, y) = 0, then 
x and y cannot differ in any position and 
x=y. 


7.1. 
9. (a) 3. (b) 2 or fewer. 
11. Let a = 0000000, b = 0010110, ¢ = 0101000, 


TAQ oe Qa aos 


d = 0111110, e = 1000101, f = 1010011, 
g = 1101101, A = 1111011. 


b c d e f g h 
a b c d e f 8 h 
b a d c f e h g 
c doa b ge oA e f 
d c b a h 8 f e 
e f g h a b c d 
f e h g b a d c 
g h e f c d a b 
h g f e d c b a 


13. 2. 
0 0 0 
1 0 0 
15. 101! 
0 1 0 
0 1 1 
17,.{1 1 Of. 
a 


19. e,{000) = 000000 
e,A001) = 001111 
e,,(010) = 010011 
e,,(011) = 011100 


e,,(100) = 100100 
e,(101) = 101011 
e,(110) = 110111 
e,(111) = 111000 


Exercise Set 11.2, page 441 


1. (a) O11 (b) 101 

3.0 

5.0 

71 

9% (a) 01 (b) 11 (ce) 10 
11. (a) 010 = (b) 110 


(c) 001 are possible answers 


13. (a) 01 (b) 11 
(c) 10 are possible answers 


15. (a) 001 (b) 101 
(c) 110 are possible answers 


Exercise Set for Appendix A, 
page 455 


1. FUNCTION TAX (INCOME) 
1. IF INCOME = 30,000) THEN 
a. TAXDUE © 6000 
2. ELSE 
a. IF (INCOME = 20,000) THEN 
1. TAXDUE < 2500 
b. ELSE 
1. TAXDUE « INCOME x 0.1 
3. RETURN (TAXDUE) 
END OF FUNCTION TAX 


11, 1. 


. SUM< 0 
. FOR? = 1THRUN 


a. SUM © SUM + 4I/] 


. AVERAGE <— SUM/N 


. DOTPROD < 0 
. FOR J = 1 THRU 3 


a. DOTPROD « DOTPROD + 
(XUD(YED 


. RAD < (A[2])? ~ 4(4[1)(413)) 
. IF (RAD < 0) THEN 


a. PRINT (ROOTS ARE IMAGINARY’) 


. ELSE 


a, IF (RAD = 0) THEN 
L Rl] — Al2]/(2A[1]) 
2. PRINT (ROOTS ARE REAL AND 
EQUAL) 
b ELSE 
1. Rl — (—A[2] + SQ(RAD)) /(24[1]) 
2. R2<— (—A[2] — SQ(RAD)) /(24[1]) 


. FOR / = 1THRUN 


a. IF (A[J] # B[J]) THEN 
1. CJ 

b. ELSE 
1. Ci] <0 


FOR 7 = 1 THRU N 

a. IF (A[I] = 0 AND B[J] = 0) THEN 
1 Cije—1 

b. ELSE 
1. c{i]<0 


17. 1. 
. FOR 7 = 1 THRU 77 


19. 1. 
. FOR 7 = 1 THRU 10 
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. SUM €0 
. FOR J = 0 THRU 2(N — 1) BY2 


a. SUM¢ SUM +1 


. PROD< 1 
. FOR J = 2 THRU 2N BY 2 


a. PROD < (PROD) x I 
SUM <0 
a. SUM — SUM + /? 


SUM «+ 0 


a. SUM — SUM + (1/(37 + 1)) 


21. MAX returns the larger of X and Y. 


23, F returns |X|. 


511 


25. Assigns 1 to R if N| M and assigns 0 otherwise. 


N 
27.X= Db lisN +1. 


f=1 


INDEX 


A 
Abelian group, 349 


Absorption properties of a lattice, 252 


Absurdity, 54 
Acceptance state, 393 


Acyclic symmetric relation, 312 


Addition principle, 11 
for disjoint sets, 11 


Adjacent vertices, 127, 199, 310 


Algorithm(s), 23, 444 
branch of, 446 
Euclidean, 25 
Fleury’s, 209 
greedy, 323 
Kruskal’s, 324-325 
Prim’s, 317-318, 322-323 
running time of, 194, 466 
structured, 446 
subroutine of, 445 
Warshall’s, 160 

Alphabet, 19 


Alternating group on n letters, 356 


And gate, 268 
Antecedent statement, 52 
Antisymmetric relation, 124 
Argument of a function, 168 
Array 

of dimension two, 32 

linear, 16 

m by n, 33 
Associative operation, 40, 332 
Associative property, 40 
Associative properties 

of a lattice, 251 

of logical operations, 56 

of set operations, 10 
Asymmetric relation, 124 
Automaton, pushdown, 474 


Axioms for probability space, 89 


Backus-Naur notation, 378 
Backtracking, 95 


Base 2 exponential function, 178 


Basis step of induction, 64 

Biconditional statement, 53 

Bijection, 172 

Binary operation, 40 
associative, 40, 332 
commutative, 40, 332 
idempotent property of, 332 


identity of, 41 
on a set, 330 
Binary tree, 290 
complete, 290 
positional, 294 
Block 
maximal compatibility, 464 
of a partition, 103 
BNF notation, 378 
Boolean algebra, 261 
De Morgan’s laws for, 263 
involution property of, 263 
properties of, 263 
substitution rule for, 262 
Boolean expression, 268 
Boolean function, 179 
Boolean matrices 
mod 2 product of, 427 
mod 2 sum of, 426 
product of, 36 
Boolean matrix, 35 
complement of, 148 
Boolean polynomial, 267 
Boolean product, 36 
mod 2, 427 


Boolean sum (mod 2) of matrices, 426 


Bound 

greatest lower, 242 

least upper, 242 

lower, 242 

upper, 242 
Bounded lattice, 253 
Branch of an algorithm, 446 
Bridge, 209 
B-tree of degree k, 471 


Cc 


CALL statement, 445, 453 
Cancellation property 
left, 350 
right, 350 
Cardinality of a set, 4 
Cartesian product, 102, 103 
Catenation of strings, 19 
Ceiling function, 178 
Cell 
of a partition, 103 
storage, 137 
Central operator, 292 
Certain event, 87 
Chain, 227 
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Chain (cont.) 

Markov, 468 
Characteristic equation, 97 
Characteristic function of a set, 17, 177 
Chosen at random, 90 
Chromatic number, 218 
Chromatic polynomial, 220 
Circuit, 199 

Euler, 204 

Hamiltonian, 213 

simple, 199 
Circular relation, 136 
Class 

lower, of functions, 192 
Clique, 476 
Closed with respect to an operation, 40, 330 
Closure 

of an operation, 40 

reflexive, 151 

of a relation, 151 

symmetric, 151 

transitive, 151, 157 
Code 

group, 425 

parity check, 422 
Code word, 422 
Collision, 180 
Coloring of a graph, 218 

proper, 218 
Column of a matrix, 30 
Combination of n objects taken r at a time, 78 

number of, 79 

with repeats, 79 

Common divisor, 24 

greatest, 24 
Common multiple, 26 

least, 26 
Commutative operation, 40, 332 
Commutative properties 

of a lattice, 251 

of logical operations, 56 

of set operations, 10 
Comparable elements of a poset, 226 
Compatibility block 

maximal, 464 

relation, 464 
Compatible strings, 413 
Complement 

of a Boolean matrix, 148 

of an element of a lattice, 254 

properties of, 10 

of a set,7 

of set B with respect to A,7 
Complementary relation, 146 
Complemented lattice, 255 


Complete binary tree, 289 
Complete graph, 200 
Complete n-tree, 289 
Component of a graph, 199 
Composition 

of paths, 121 

of permutations, 182 

of relations, 152 
(Compound statement, 47 
(omputer representation 

of a digraph, 136-144 

of a positional binary tree, 295-296 

of a relation, 136-144 

of a set, 17 

of a tree, 306 
Conclusion, 59 

of an implication, 52 
Conditional statement, 52 
Conditions for a recurrence relation, 95 
Congruence 

machine, 393 

mod a, 27 

relation, 342, 362 
Congruent to r mod a, 27 
Conjunction of statements (propositions), 48 
Connected graph, 199 
Connected symmetric relation, 127 
Connective, 47 
Connectivity relation, 117 
Consequent statement, 52 
Constructive proof, 82 
Context-free grammars, 376 
Context-sensitive grammars, 376 
Contingency, 54 
Contradiction, 54 

proof by, 61 
Contrapositive of an implication, 53 
Converse of an implication, 53 
Corrects k or fewer errors, 433 
Correspondence 

one to one between A and B, 173 
Coset 

leader, 436 

left, of a subgroup, 363 

right, of a subgroup, 363 
Countable set, 18 
Counterexample, 63 
Counting 

multiplication principle of, 73 
Covering of a set, 464 
Cycle(s), 117 

disjoint, 185 

as a permutation, 183 

simple, 311 


Cyclic 
group, 473 
permutation, 183 


D 


Decoding function, 432-433 

maximum likelihood, 434 
Decoding table, 437 
Degree of a vertex, 198 
De Morgan’s laws 

for Boolean algebras, 263 

for mathematical structures, 41 

for sets, 10 

for statements, 56 
Derivation of a sentence, 371 
Derivation tree, 373 
Descendants of a vertex, 290 
Detect k or fewer errors, 422 
Deterministic, 85 
Diagonal 

main, of a matrix, 30 

matrix, 31 
Diagram 

Hasse, 231 

logic, 269 

master, 387 

syntax, 381 

Venn, 3 
Digraph, 111 

cycle in, 117 

edge of, 111 

of a finite-state machine, 393 

labeled, 169 

path in, 116 

of a relation, 111 

vertex of, 111 
Direct derivability, 370 
Directed graph; see Digraph 
Disconnected graph, 199 
Discrete graph, 200 
Disjoint 

cycles, 185 

events, 87 

sets, 6 
Disjunction of statements (propositions), 48 
Distance 

Hamming, 424 

minimum, of an encoding function, 424 

between vertices, 322 
Distributive lattice, 253 
Distributive properties 

of a lattice, 253 

of logical operations, 56 

of set operations, 10 
Distributive property, 40 


Index 


Divides, 22 
Divisor 

common, 24 

greatest common, 24 
Domain of a relation, 109 
Doubly linked list, 295 
Dual partial order, 226 
Dual poset, 226 


E 


Edge, 111, 197 

end points of, 198 

undirected, 127, 310 

weight of, 215, 321 
Element 

complement of, 254 

greatest, of a poset, 240 

idempotent, 341 

identity, 335 

inverse of, 349 

least, of a poset, 240 

of a matrix, 31 

maximal, of a poset, 239 

minimal, of a poset, 239 

order of, 472 

of a set, 1 

syndrome of, 439 

unit, of a poset, 241 

zero, of a poset, 241 
Elementary event, 89 
Elementary probability, 89 
Empty relation, 124 
Empty sequence, 19 
Empty set, 2 

properties of, 10 
Empty strings, 19 
Encoding function, 422 
End points, 198 
Entry 

of a matrix, 31 
Equality 

of matrices, 31 

of relation, 124 

of sets, 3 
Equally likely outcomes, 90 
Equivalence, 53 
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Equivalence classes of an equivalence relation, 134 


Equivalence relation, 131 
determined by a partition, 132 
Equivalent machines, 413 
Equivalent statements, 55 
Errors 
corrects k or fewer, 433 
detect & or fewer, 422 
k or fewer, 422 
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Euclidean algorithm, 25 
Euler circuit, 204 
Euler path, 204 
Even permutation, 186 
Event(s), 86 

certain, 87 

disjoint, 87 

elementary, 89 

frequency of occurrence, 88 

impossible, 87 

mutually exclusive, 87 

probability of, 87 
Everywhere-defined function, 171 
Existence proof, 82 
Existential quantification, 50 
Explicit formula, 15 
Exponential function 

base 2, 178 
Expression 

Boolean, 268 

regular, 19 

over A, 19 


F 


Factor semigroup, 344 
Factorial 
n,75 
Fibonacci sequence, 95 
Finite group, 352 
Finite sequence, 14 
Finite set, 4 
Finite-state machine, 391 
congruence on, 393 
digraph of, 393 
input set of, 391 
monoid of, 400 
quotient of, 394 
state of, 391 
state set of, 391 
state transition table of, 391 
Fleury’s algorithm, 209 
Floor function, 84, 178 
Flow chart, 447 
Formula 
explicit, 15 
recursive, 15 
FOR statement, 452 
Free monoid, 398 
Free semigroup, 335 


Frequency of occurrence of E£ in n trials, 88 


Function, 167 
argument of, 168 
base 2 exponential, 178 
Boolean, 179 
ceiling, 178 


characteristic, of a set, 17,177 

decoding associated with e, 432-433 

distance, 424 

encoding, 422 

everywhere defined, 171 

floor, 84, 178 

hashing, 179 

identity, 170 

invertible, 173 

log base 2, 178 

maximum likelihood decoding, 434 

mod n, 28, 177 

one to one, 171 

onto, 171 

permutation, 181 

propositional, 49 

State transition, 391 

corresponding to a string, 398 

value of, 168 
FUNCTION statement, 453 
Fundamental homomorphism theorem, 345 


G 


Gate 

and, 268 

or, 268 
GO TO statement, 446, 454-455 
Grammar, 370 

context-free, 376 

context-sensitive, 376 

phrase structure, 370 

regular, 376 

Type n (n = 0,1, 2, 3), 376 
Graph, 197 

coloring of, 218 

complete, 200 

components of, 199 

connected, 199 

disconnected, 199 

discrete, 200 

linear, 200 

path in, 199 

planar, 219 

quotient, 202 

regular, 200 

sub-, 200 

of a symmetric relation, 127 

weighted, 321 
Greatest common divisor, 24 
Greatest element of a poset, 240 
Greatest lower bound, 242 
Greedy algorithm, 323 
Group(s), 349 

Abelian, 349 

alternating, on n letters, 356 

code, 425 


cyclic, 473 

finite, 352 

inverse in, 349 

Klein 4, 359 

normal subgroup of, 363 

order of, 352 

product of, 361 

quotient, 362 

subgroup of, 356 

symmetric, on 7 letters, 355 

of symmetries of the triangle, 355 
Group code, 425 


H 


Hamiltonian circuit, 213 
Hamiltonian path, 213 
Hamming distance, 424 
Hashing function, 179 
Hasse diagram, 231 
Height of a tree, 288 
Homogeneous linear relation of degree k, 96 
Homomorphic image, 339 
Homomorphism 
fundamental theorem, 345 
kernel of, 364 
natural, 345 
of semigroups, 339 
Hypotheses, 59 
Hypothesis, 52 


Idempotent element, 341 
Idempotent properties 
of a binary operation, 332 
of a lattice, 251 
of logical operations, 56 
of a set, 10 
Identity 
of a binary operation, 41 
element, 335 
function, 170 
matrix, 34 
IF THEN ELSE statement, 446, 449 
Image 
homomorphic, 339 
Image of a, 168 
Implication, 52 
contrapositive of, 53 
converse of, 53 
Impossible event, 87 
Incomparable elements of a poset, 235 
In-degree of a vertex, 113 
Indirect method of proof, 61 
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Induction 

principle of mathematical, 64 
Induction step, 64 
Inequality relation, 124 
Inference 

tules of, 59 
Infinite sequence, 14 
Infinite set, 4 
Infix notation, 304 
Influence 

two-stage, 475 
Initial conditions for a recurrence relation, 95 
Inorder search of a tree, 303 
Input of a machine, 391 
Input-output relation, 169 
Input set of a machine, 391 
Interior vertices of a path, 159 
Intersection of sets, 6 
Interval in a lattice, 257 
Invariant 

loop, 68 
Inverse 

of a binary operation, 41 

of an element, 349 

relation, 146 
Inverter, 269 
Invertible function, 173 
Involution property in a Boolean algebra, 263 
Irreflexive relation, 124 
Isolated vertex, 199 
Isomorphic lattices, 250 
Isomorphic posets, 234 
Isomorphic semigroups, 337 


J 


Join of two elements in a lattice, 246 
Join of two matrices, 35 


K 


Karnaugh map, 274 

Kernel, 364 

Key, 179 

Klein 4 group, 359 

Kruskal’s algorithm, 324-325 
k or fewer errors, 422, 433 


L 


Labeled digraph, 169 
Labeled tree, 292 
Language 
of a Moore machine, 402 
of a phrase structure grammar, 371 
semantics of, 369 
syntax of, 369 
Type n (n = 0,1, 2, 3), 376 
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Lattice(s), 246 
absorption properties of, 252 
associative properties of, 251 
commutative properties of, 251 
bounded, 253 
complemented, 255 
distributive, 253 
distributive properties of, 253 
idempotent properties of, 251 
isomorphic, 250 
modular, 257 
nondistributive, 253 
sub-, 249 
Laws 
De Morgan’s, 10, 41, 56, 263 
distributive, 253 
Least common multiple, 26 
Least element of a poset, 240 
Least upper bound, 242 
Leaves of a tree, 288 
Left cancellation property, 350 
Left coset of a subgroup, 363 
Left pointer, 295 
Left side of production, 370 
Left subtree, 300 
Lemma, 133 
Length 
of a path, 116 
of a string, 376, 401 
Less than relation, 125 
Level 
same, 449 
in a tree, 287 
Level n vertices, 287 
Lexicographic order, 228 
Ig, log base 2 function, 180 
Likelihood 
maximum decoding function, 434 
maximum technique, 434 
Linear array, 16 
Linear graph, 200 
Linear homogeneous relation of degree k, 96 
Linear order, 227 
Linearly ordered set, 227 
Linked-list representation 
of a relation, 138-139 
of a sequence, 136-138 
of a tree, 306 
List, 16 
doubly linked, 295 
Local variable, 454 
Log base 2 function, 178 
Logic diagram, 269 
Logic gate, 268 
Logical connectives, 47-49 
Logically follows, 59 


Logically equivalent propositions (statements), 55 
Loop, 198, 447 

Loop invariant, 68 

Lower bound, 242 

Lower class, 192 

Lower order, 191 


M 


Machine(s) 
congruence, 393 
equivalent, 413 
finite-state, 391 
input(s) of, 391 
input set of, 391 
language of, 402 
monoid of, 400 
Moore, 393 
output of, 391 
quotient, 394 
quotient Moore, 396 
recognition, 393 
state of, 391 
state set of, 391 
state transition function of, 391 
state transition table of, 391 
Main diagonal of a matrix, 30 
Map 
Karnaugh, 274 
Mapping, 168 
Markov chain, 468 
regular, 469 
state vector of, 468 
Master diagram of a regular grammar, 387 
“Mathematical structure, 39 
Mathematical system, 39 
Mathematical induction 
principle of, 64 
Matrices 
Boolean product of, 36 
equal, 31 
join of, 35 
meet of, 35 
mod 2 sum of, 426 
mod 2 Boolean product of, 427 
product of, 32 
sum of, 31 
Matrix, 30 
Boolean, 35 
Boolean, complement of, 148 
column of, 30 
diagonal, 31 
element of, 31 
identity, 34 
(i,f)th element of, 31 
(i,j) entry of, 30 


main diagonal of, 30 


parity check, 429 

of a relation, 111 

tow of, 30 

square, 30 

symmetric, 34 

transition, 468 

transpose of, 34 

zero, 32 
Maximal compatibility block, 464 
Maximal element of a poset, 239 
Maximum likelihood decoding function, 434 
Maximum likelihood technique, 434 
Meet 

of two elements in a lattice, 247 

of two matrices, 35 
Message, 421 
Minimal element of a poset, 239 
Minimal spanning tree, 322 
Minimum distance of an encoding function, 424 
Minterm, 272 
Mod 2 Boolean product, 427 
Mod 2 sum, 426 
Mod n function, 28, 178 
Modular lattice, 257 
Modulus, 27 
Modus ponens, 60 
Monoid, 335 

idempotent element in, 341 

of a machine, 400 

sub-, 336 
Moore machine, 393 

acceptance state of, 393 

language of, 402 

quotient, 396 

starting state of, 393 
Multiple 

common, 26 

least common, 26 
Multiplication principle of counting, 73 
Multiplication table, 351 
Mutually exclusive event, 87 


N 


Natural homomorphism, 345 
Negation 

properties of, 56 

of a statement, 47 
Neighbor 

nearest, of a vertex, 322 

nearest, of a set vertices, 322 
Noise, 421 
Nondistributive lattice, 253 
Nonterminal symbol, 370 
Normal subgroup, 363 
Normal production, 379 
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Notation 
Backus-Naur, 378 
infix, 304 
postfix, 304 
prefix, 302 

n-tree, 290 
complete, 290 


oO 


O (big oh), 191 
Odd permutation, 186 
Offspring of a vertex in a tree, 287 
One-to-one correspondence between A and B, 172 
One-to-one function, 171 
Onto function, 171 
Operation, 40, 330 
associative, 40, 332 
binary, 40 
on a set, 330 
commutative, 40, 332 
idempotent property of binary, 332 
table, 331 
unary, 40 
Order 
of an element in a group, 472 
of a group, 352 
lexicographic, 228 
linear, 227 
lower, 191 
partial, 225 
product partial, 228 
same, 191 
Ordered pair, 101 
Ordered tree, 289 
Or gate, 268 
Outcome(s), 86 
equally likely, 90 
Out-degree of a vertex, 113 
Output of a machine, 391 


P 


Parent, 287 
Parity check code, 422 
Parity check matrix, 429 
Parse tree, 376 
Parsing a sentence, 376 
Partial order, 225 
dual, 226 
product, 228 
Partially ordered set, 225 
Partition, 103 
block of, 103 
cell of, 103 
Path(s) 
composition of, 121 
Euler, 204 
in a graph, 199 
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Path(s) (cont.) 
Hamiltonian, 213 
interior vertices of, 159 
length of, 116 
in relations, 116 
simple, 199, 311 

Permutation(s), 75 
cyclic, 183 
even, 186 
function, 181 
of n objects taken r at a time, number of, 75 
odd, 186 
product of, 182 

Phrase structure grammar, 370 
derivation in, 371 
language of, 371 
nonterminal symbol of, 370 
production of, 370 
production relation of, 370 
regular, 376 
terminal symbol of, 370 
Type n, (n = 0,1,2,3), 376 

Pigeonhole principle, 82 
extended, 84 

Planar graph, 219 

Pointer, 137 
left, 295 
right, 295 

Polish form, 302 
Teverse, 304 

Polynomial 
Boolean, 267 
chromatic, 220 

Poset(s), 225 
dual, 226 
greatest element of, 240 
Hasse diagram of, 231 
isomorphic, 234 
join of, 246 
least element of, 240 
linearly ordered, 227 
maximal element of, 239 
minimal element of, 239 
unit element of, 241 
zero element of, 241 

Positional tree, 294 
binary, 294 

Postfix form, 304 

Postorder search, 303 

Power set of a set, 4 

Predicate, 49 

Prefix form, 302 

Premises, 59 

Preorder search of a tree, 300 

Prime 
relatively, 24, 130 

Prime number, 23 


Prim’s algorithm, 317-318, 322-323 
Principle 
addition, 11 
of correspondence, 235 
extended pigeonhole, 84 
of mathematical induction, 64 
multiplication, of counting, 73 
pigeonhole, 82 
PRINT statement, 455 
Probabilistic, 85 
Probability 
elementary, 89 
of an event, 87 
space, axioms for, 89 
transition, 468 
Product 
Boolean, of two matrices, 36 
Cartesian, 102, 103 
of two groups, 361 
of two matrices, 32 
of two permutations, 182 
of two semigroups, 342 
mod 2 Boolean, 427 
partial order, 228 
in a semigroup, 334 
set, 102 
Production, 370 
left, 370 
normal, 379 
recursive, 379 
right, 370 
Production relation, 370 
Proof 
constructive, 82 
by contradiction, 61 
existence, 82 
indirect method, 61 
steps in, 62 
Proper coloring of a graph, 218 
Property 
absorption, 252 
associative, 10, 40, 56, 251, 332 
cancellation, 350 
commutative, 10, 40, 56, 251, 332 
of the distance function, 424 
distributive, 10, 40, 56, 253 
of the empty set, 10 
idempotent, 10, 56, 251, 332 
Froposition(s), 46 
conjunction of, 48 
disjunction of, 48 
equivalent, 55 
logically equivalent, 55 
negation of, 47 
Propositional function, 49 
Fropositional variable, 47 


Prove a theorem, 59 
Pseudocode, 28, 447, 449 
Pushdown automaton, 474 


Q 


Quantification 
existential, 50 
universal, 49 
Quantifiers, 49-50 
Quasiorder, 238 
Quotient 
finite-state machine, 394 
graph, 202 
group, 362 
Moore machine, 396 
semigroup, 344 
set, 103 
of an equivalence relation, 134 


Random selection, 90 
Range of a relation, 109 
Reachability relation, 121 
Recognition machine; see Moore machine 
Recurrence relation, 95 
characteristic equation of, 97 
linear homogeneous of degree k, 96 
Recursive formula, 15; see also Recurrence relation 
Recursive production, 379 
Reflexive closure of a relation, 151 
Reflexive relation, 124 
Regular expression, 19 
over A, 19 
Regular grammar, 376, 385 
Regular graph, 200 
Regular Markov chain, 469 
Regular set, 20, 385 
Regular subset, 20 
Relation(s), 106 
on A, 106 
from A to B, 106 
acyclic symmetric, 312 
antisymmetric, 124 
asymmetric, 124 
circular, 136 
closure of, 151 
compatibility, 464 
complementary, 146 
composition of, 152 
computer representation of, 138-139 
congruence, 342, 362 
connected symmetric, 127 
connectivity, 117 
digraph of, 111 


Index 


domain of, 109 

empty, 124 

equality, 124 

equivalence, 131 

classes of, 134 
determined by a partition, 132 

graph of symmetric, 127 

inequality, 124 

input-output, 169 

inverse, 146 

irreflexive, 124 

less than, 125 

linear homogeneous, of degree k, 96 

matrix of, 111 

partial order, 225 

path in, 116 

production, 370 

quasiorder, 238 

range of, 109 

reachability, 121 

recurrence, 95 

reflexive, 124 

reflexive closure of, 151 

restriction of, 114 

on a set, 106 

symmetric, 124 

symmetric closure of, 151 

transitive, 128 

transitive closure of, 151, 157 
Relatively prime, 24, 130 
Restriction of a relation, 114 
RETURN statement, 445, 452-453 
Reverse Polish form, 304 
Right cancellation property, 350 
Right coset of a subgroup, 363 
Right pointer, 295 
Right side of a production, 370 
Right subtree, 300 
Root of a tree, 287 
Rooted tree, 287 
Row of a matrix, 30 
R-relative set 

of A, 109 

of x, 109 
Rules of inference, 59 
Running time of an algorithm, 194, 466 


S 


Same level, 449 
Same order, 191 
Sample space, 86 
Search 
inorder, 303 
postorder, 303 
preorder, 300 
tree, 299 
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Searching a tree, 299 
Selection, 447 
random, 90 
Semantics of a language, 369 
Semigroup(s), 334 
factor, 344 
free, 335 
homomorphism, 339 
isomorphic, 337 
isomorphism, 337 
product of, 334 
quotient, 344 
sub-, 335 
Sentence parsing, 376 
Sequence, 14 
empty, 19 
Fibonacci, 95 
finite, 14 
infinite, 14 
initial conditions for, 95 
set corresponding to, 16 
of values, 16 
Set(s), 1 
alphabet, 19 
binary operation on, 330 
cardinality of, 4 
characteristic function of, 17 
closed, 330 
combination of, taken 7 at a time, 78 
complement of, 7 
complement of B with respect to A,7 
contained in, 3 
corresponding to a sequence, 16 
countable, 18 
disjoint, 6 
element of, 1 
empty, 2 
equal, 3 
finite, 4 
infinite, 4 
input, of a machine, 391 
intersection of, 6 
linearly ordered, 227 
member of, 1 
mutually exclusive, 87 
operations, properties of, 10 
partially ordered, 225 
partition of, 103 
permutation of, 75 
power set of, 4 
product, 102, 334 
quotient, 103 
regular, 20 
regular expression over, 19 
R-relative, 109 
state, of a machine, 391 


strings from, 19 
subset of, 3 
symmetric difference of, 9 
uncountable, 18 
union of, 6 
universal, 3 
Venn diagram of, 3 
Sibling of a vertex, 287 
Simple circuit, 199 
Simple cycle, 311 
Simple path, 199, 311 
Sorting 
topological, 233 
Space 
probability, 89 
axioms for, 89 
sample, 86 
Spanning tree, 314 
minimal, 322 
undirected, 315 
Square matrix, 30 
Starting state, 393 
State(s), 391, 468 
acceptance, 393 
set of a machine, 391 
starting, 393 
transition function, 391, 398 
transition table, 391 
of a finite-state machine, 391 
vector, of a Markov chain, 468 
Statement(s), 46 
CALL, 445, 453 
compound, 47 
conjunction of, 48 
contradiction of, 54 
contrapositive of, 53 
converse of, 53 
disjunction of, 48 
equivalent, 55 
FOR, 452 
GO TO, 446, 454-455 
IF THEN ELSE, 446, 449 
logically equivalent, 55 
logically following from, 58 
negation of, 47 
PRINT, 454 
RETURN, 445, 452-453 
UNTIL, 447, 451 
WHILE, 447, 450 
Steady-state vector, 469 
Steps in A proof, 62 
Storage cell, 137 
String(s), 15, 19 
catenation of, 19 
compatible, 413 


empty, 19 

length of, 376 
Structure, mathematical, 39 
Structured algorithm, 446 
Subgraph, 200 
Subgroup, 356 

coset of, 363 

normal, 363 

trivial, 356 
Sublattice, 249 
Submonoid, 335 
Subroutine, 445, 452 
SUBROUTINE statement, 452 
Subsemigroup, 335 
Subset, 3 

regular, 20 
Substitution rule for Boolean algebras, 262 
Subtree 

corresponding to a vertex, 290 

left, 300 

right, 300 

of a tree, 290 
Sum 

of matrices, 31 

mod 2, 426 
Symmetric closure of a relation, 151 
Symmetric difference, of two sets, 9 
Symmetric group on 7 letters, 355 
Symmetric matrix, 34 
Symmetric relation, 124 

acyclic, 312 

graph of, 127 
Symmetry of a figure, 353 
Syndrome of an element, 439 
Syntax 

diagram, 381 

of a language, 369 
System, mathematical, 39 


T 


Table 
binary operation, 331 
decoding, 437 
multiplication, 351 
state transition, 391 
truth, 47, 267 
Tautology, 54 
Terminal symbol, 370 
T flip-flop, 391 
Theta class, 192 
Time 
running, of an algorithm, 194, 466 
Topological sorting, 233 
Transformation, 168 
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Transition 

matrix, 468 

probability, 468 
Transition function 

state, 391 

state corresponding to a string, 398 
Transitive closure of a relation, 151, 157 
Transitive relation, 128 
Transpose of a matrix, 34 
Transposition, 185 
Traveling Salesperson Problem, 216 
Traversing a tree, 299 
Tree(s), 286 

binary, 290 

B- of degree k, 471 

complete binary, 290 

complete n-tree, 290 

computer representation of positional binary, 295 

derivation, 373 

height of, 288 

inorder search of, 303 

labeled, 292 

leaves of, 288 

linked list representation of, 306 

minimal spanning, 322 

n-tree, 290 

ordered, 289 

parse, 376 

positional, 294 

positional binary, 294 

postorder search of, 303 

preorder search of, 300 

root of, 287 

rooted, 287 

search, 299 

searching, 299 

spanning, 314 

subtree of, 289, 300 

traversing, 299 

undirected, 310 

edge in, 310 
spanning, 315 

vertex of, 287 

walking, 299 
Truth table, 47, 267 
Two-stage influence, 475 
Type n (n = 0,1, 2,3) 

language, 376 

phrase structure grammar, 376 


U 

Unary operation, 40 
Uncountable set, 18 
Undirected edge, 127, 310 
Undirected spanning tree, 315 
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Undirected tree, 310 
Union of sets, 6 
Unit element of a poset, 241 
Universal quantification, 49 
Universal set, 3 

properties of, 10 
UNTIL statement, 447, 451 
Upper bound, 242 


Vv 


Value of a function, 168 
Variable 
local, 454 
Vector 
state, 468 
steady-state, 469 
Venn, John, 3 
Venn diagram, 3 
Vertex, 111, 197 
degree of, 198 
descendants of, 290 
in-degree of, 113 
isolated, 199 
level n, 287 
nearest neighbor of, 322 
offspring of, 287 


out-degree of, 113 
subtree beginning with, 290 
in a tree 7, 287 
visiting, 299 

Vertices 
adjacent, 127, 199, 310 
distance between, 322 
interior, of a path, 159 
nearest neighbor of, 322 


Ww 


Walking a tree, 299 
Warshall’s algorithm, 160 
Weight 

of an edge, 215, 321 

of a word, 422 
Weighted graph, 321 
WHILE statement, 447, 450 
Word, 19, 421 

code, 422 

weight of, 422 


Zz 
Zero 


element of a poset, 241 
matrix, 32 


Examples of Pseudocode Constructs 


1XxX<0 

2. Y<0 

3. UNTIL (X = N) 
aXe-X+1 
bYeV+X 

4.Y< Y/2 

END GF ALGORITHM 


FUNCTION SOR(N) 

1XeN 

2. Yel 

3. WHILE (Y # N) 
aXeX+N 
bY<AY1 

4. RETURN (X) 

END OF FUNCTION SOR 


1. FOR = 1 THRU N 
a. IF ((A[/] = 1) OR (B[Z] = 1)) THEN 
tC [fj 1 
b. ELSE 
1. Cl] <0 


FUNCTION F(X) 
1. IF (X < 1) THEN 
a. Re X?+1 
2. ELSE 
a. IF (X < 3) THEN 
1. RE2X4+6 
b. ELSE 
1REX+7 
3. RETURN (R) 
END OF FUNCTION F 


Examples of BNF and Syntax Diagrams 


G = (V, S, identifier, >) 

N = {identifier, remaining, digit, letter} 
S40 By Cyyiie 0 5B Oy Ly Bs Bys 22:5 9} 
V=NUS 


1. (identifier) ::= (letter)| (letter) (remaining) 

2. (remaining) ::= (letter) | (digit)| (letter) 
{remaining)| (digit) (remaining) 

3. (letter) == alblc|-- -[z 

4. {digit) ::= 0|1]2|3]4|5|6|7|8|9 


identifier 


remaining 
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MATHEMATICAL 
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